[ 629.519092] env[70032]: INFO neutron.common.config [-] Logging enabled! [ 629.519423] env[70032]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev34 [ 629.519538] env[70032]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70032) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 629.519973] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 629.519973] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 629.520716] env[70032]: WARNING oslo_policy.policy [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 629.520940] env[70032]: WARNING oslo_policy.policy [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 629.522409] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] VMware NSXv3 Agent initialized successfully. [ 629.522770] env[70032]: DEBUG oslo_concurrency.lockutils [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] Acquiring lock "singleton_lock" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.522912] env[70032]: DEBUG oslo_concurrency.lockutils [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] Acquired lock "singleton_lock" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.523160] env[70032]: DEBUG oslo_concurrency.lockutils [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] Releasing lock "singleton_lock" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.523448] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] Full set of CONF: {{(pid=70032) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 629.523656] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ******************************************************************************** {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 629.523781] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] Configuration options gathered from: {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 629.524027] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 629.524204] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 629.524323] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ================================================================================ {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 629.524502] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] agent_down_time = 75 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.524651] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] allow_automatic_dhcp_failover = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.524797] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] allow_bulk = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.524949] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] api_extensions_path = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.525110] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] api_paste_config = api-paste.ini {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.525262] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] auth_strategy = keystone {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.525377] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] backdoor_port = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.525487] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] backdoor_socket = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.525634] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] backlog = 4096 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.525780] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] base_mac = fa:16:3e:00:00:00 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.525944] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] bind_host = 0.0.0.0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.526105] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] bind_port = 9696 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.526254] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] client_socket_timeout = 900 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.526401] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] config_dir = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.526518] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.526662] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] config_source = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.526809] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] control_exchange = neutron {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.526959] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] core_plugin = ml2 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.527121] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] debug = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.527271] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] default_availability_zones = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.527661] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.527661] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] dhcp_agent_notification = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.527792] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] dhcp_agents_per_network = 1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.527911] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] dhcp_lease_duration = 86400 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.528072] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] dhcp_load_type = networks {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.528226] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] dns_domain = openstacklocal {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.528373] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.528515] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] enable_default_route_bfd = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.528859] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] enable_default_route_ecmp = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.528859] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] enable_dvr = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.528959] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] enable_new_agents = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.529083] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.529225] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] enable_signals = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.529364] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] enable_traditional_dhcp = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.529499] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] external_dns_driver = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.529637] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] filter_validation = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.529787] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] global_physnet_mtu = 8950 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.529929] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] graceful_shutdown_timeout = 60 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.530122] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] host = cpu-1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.530277] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] host_dvr_for_dhcp = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.530422] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] http_retries = 3 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.530572] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] instance_format = [instance: %(uuid)s] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.530721] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.530868] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ipam_driver = internal {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.531045] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ipv6_pd_enabled = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.531206] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] l3_ha = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.531358] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.531507] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] l3_ha_network_physical_name = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.531654] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] l3_ha_network_type = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.531802] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_color = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.531946] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_config_append = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.532111] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.532300] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_dir = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.532403] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_file = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.532506] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_options = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.532649] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_rotate_interval = 1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.532838] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_rotate_interval_type = days {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.532943] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] log_rotation_type = none {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.533093] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.533223] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.533364] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.533513] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.533627] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.533773] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] max_dns_nameservers = 5 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.533917] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] max_header_line = 16384 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.534097] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] max_l3_agents_per_router = 3 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.534251] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] max_logfile_count = 30 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.534394] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] max_logfile_size_mb = 200 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.534535] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] max_subnet_host_routes = 20 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.534685] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] my_ip = 10.180.1.21 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.534831] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] my_ipv6 = ::1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.534973] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] network_auto_schedule = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.535124] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] network_link_prefix = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.535273] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.535422] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] notify_nova_on_port_data_changes = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.535569] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] notify_nova_on_port_status_changes = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.535716] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] pagination_max_limit = -1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.535859] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] publish_errors = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.536023] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] rate_limit_burst = 0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.536168] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] rate_limit_except_level = CRITICAL {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.536312] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] rate_limit_interval = 0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.536454] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] retry_until_window = 30 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.536596] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] router_distributed = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.536738] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] rpc_resources_processing_step = 20 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.536902] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] rpc_response_max_timeout = 600 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.537116] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] rpc_response_timeout = 60 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.537190] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] send_events_interval = 2 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.537331] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] service_plugins = ['router'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.537481] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] setproctitle = on {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.537620] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] shell_completion = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.537768] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] state_path = /opt/stack/data/neutron {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.537916] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] syslog_log_facility = LOG_USER {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.538071] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] tcp_keepidle = 600 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.538223] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] transport_url = **** {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.538366] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] use_journal = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.538559] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] use_json = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.538638] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] use_ssl = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.538776] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] use_stderr = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539031] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] use_syslog = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539086] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] vlan_qinq = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539207] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] vlan_transparent = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539348] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] watch_log_file = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539492] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] wsgi_default_pool_size = 100 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539631] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] wsgi_keep_alive = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539779] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.539922] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] wsgi_server_debug = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 629.540088] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_concurrency.disable_process_locking = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.540245] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.540400] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.540544] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.540693] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.540855] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.540991] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.541220] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.connection_string = messaging:// {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.541339] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.enabled = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.541495] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.es_doc_type = notification {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.541742] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.es_scroll_size = 10000 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.541796] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.es_scroll_time = 2m {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.541937] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.filter_error_trace = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.542085] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.hmac_keys = **** {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.542237] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.sentinel_service_name = mymaster {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.542445] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.socket_timeout = 0.1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.542546] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.trace_requests = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.542675] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler.trace_sqlalchemy = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.542883] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler_jaeger.process_tags = {} {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.543517] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler_jaeger.service_name_prefix = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.543517] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] profiler_otlp.service_name_prefix = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.543517] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.enforce_new_defaults = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.543611] env[70032]: WARNING oslo_config.cfg [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 629.543747] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.enforce_scope = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.543863] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.policy_default_rule = default {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.544049] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.544216] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.544372] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.544518] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.544659] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.544797] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.544940] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.545103] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_policy.remote_timeout = 60.0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.545263] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.545417] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] agent.extensions = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.545567] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.545716] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] service_providers.service_provider = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.545871] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.default_quota = -1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.546034] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.546186] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_floatingip = 50 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.546331] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_network = 100 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.546475] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_port = 500 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.546620] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.546764] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_router = 10 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.546907] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_security_group = 10 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.547061] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.547210] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.quota_subnet = 100 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.547354] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] QUOTAS.track_quota_usage = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.547509] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.547651] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep.group = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.547792] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep.helper_command = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.547937] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.548095] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep.thread_pool_size = 8 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.548239] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep.user = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.548388] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.548529] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_dhcp_release.group = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.548666] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_dhcp_release.helper_command = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.548811] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.548957] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.549109] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_dhcp_release.user = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.549260] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.549400] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_ovs_vsctl.group = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.549540] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_ovs_vsctl.helper_command = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.549687] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.549832] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.549972] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_ovs_vsctl.user = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.550135] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_namespace.capabilities = [21] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.550279] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_namespace.group = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.550419] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_namespace.helper_command = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.550564] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.550713] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_namespace.thread_pool_size = 8 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.550853] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_namespace.user = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.551417] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_conntrack.capabilities = [12] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.551417] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_conntrack.group = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.551417] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_conntrack.helper_command = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.551543] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.551620] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.551763] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_conntrack.user = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.551915] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_link.capabilities = [12, 21] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.552066] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_link.group = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.552211] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_link.helper_command = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.552376] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.552542] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_link.thread_pool_size = 8 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.552688] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] privsep_link.user = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.552854] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.553026] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.553178] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.continue_on_failed_promotions = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.553326] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.dscp = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.553475] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.dscp_inherit = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.553628] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.force_mp_to_policy = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.553775] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.locking_coordinator_url = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.553922] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.log_agent_heartbeats = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.554159] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.logging_expire = 1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.554363] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.554523] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.554683] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.polling_interval = 240 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.554834] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.554992] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.555164] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.report_interval = 30.0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.555319] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.555471] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.555625] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.555773] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.sync_skew = 60 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.555920] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.synchronization_queue_size = 20 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.556085] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT.use_helper_for_ns_read = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.556243] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] SECURITYGROUP.enable_ipset = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.556397] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] SECURITYGROUP.enable_security_group = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.556548] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.556699] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.556851] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] experimental.ipv6_pd_enabled = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.557027] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.extension_drivers = ['port_security'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.557181] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.external_network_type = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.557342] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.557496] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.overlay_ip_version = 4 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.557648] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.path_mtu = 8950 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.557797] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.physical_network_mtus = {} {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.557952] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.tenant_network_types = ['vlan'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.558120] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.558279] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ml2.type_drivers = ['vlan'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.558431] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT_CLI.neutron_port_id = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.558644] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.558722] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.558869] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.559038] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.559197] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.559350] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.559531] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.559685] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.559883] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.560050] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_login_password = **** {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.560236] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_login_port = 443 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.560390] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_login_user = admin {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.560540] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.560693] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.560841] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.561012] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.561183] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.561337] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.561489] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.561638] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.561787] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.561937] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.562112] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.562262] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.562413] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.562604] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.562765] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] vsphere.vsphere_login_password = VMware1! {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.562916] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.563101] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.563262] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.auth_section = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.563420] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.auth_type = password {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.563571] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.563712] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.certfile = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.563860] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.collect_timing = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.564017] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.endpoint_type = public {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.564170] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.insecure = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.564314] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.keyfile = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.564468] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.region_name = RegionOne {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.564616] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.split_loggers = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.564760] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] nova.timeout = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.564910] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.auth_section = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.565082] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.auth_type = password {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.565237] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.565380] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.certfile = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.565526] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.collect_timing = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.565676] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.endpoint_type = public {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.565819] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.insecure = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.565957] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.keyfile = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.566106] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.region_name = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.566250] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.split_loggers = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.566388] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] placement.timeout = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.566535] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.auth_section = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.566678] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.auth_type = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.566818] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.cafile = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.566954] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.certfile = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.567112] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.collect_timing = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.567260] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.connect_retries = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.567402] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.connect_retry_delay = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.567545] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.enable_notifications = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.567684] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.endpoint_override = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.567828] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.insecure = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.567969] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.interface = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.568119] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.keyfile = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.568263] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.max_version = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.568401] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.min_version = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.568540] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.region_name = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.568680] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.retriable_status_codes = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.568818] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.service_name = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.568956] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.service_type = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.569113] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.split_loggers = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.569259] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.status_code_retries = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.569399] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.status_code_retry_delay = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.569541] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.timeout = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.569682] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.valid_interfaces = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.569822] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ironic.version = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.569970] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] cli_script.dry_run = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.570140] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.570287] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.570434] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.570580] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.570727] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.570871] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.571054] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.571220] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.571370] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.571524] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.571667] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.571821] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.571977] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.572142] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.572287] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.572439] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.572584] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.572728] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.572878] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.573056] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.573231] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.573393] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.573544] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.573694] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.573842] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.574012] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.574182] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.574333] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.574479] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.574626] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.574773] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.ssl = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.574926] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.575089] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.575244] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.575450] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.575614] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.ssl_version = {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.575764] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.575919] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_notifications.driver = [] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.576082] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_notifications.retry = -1 {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.576254] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.576395] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 629.576532] env[70032]: DEBUG oslo_service.backend.eventlet.service [None req-36a8b06e-0876-47fd-8f42-843c69b43361 None None] ******************************************************************************** {{(pid=70032) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 629.577582] env[70032]: DEBUG neutron.agent.securitygroups_rpc [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Init firewall settings (driver=nsxv3) {{(pid=70032) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 629.579083] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70032) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 629.579334] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] RPC agent_id: nsxm-l-01a.corp.local [ 629.581586] env[70032]: DEBUG dogpile.cache.region [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.581711] env[70032]: DEBUG dogpile.lock [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.581812] env[70032]: DEBUG dogpile.lock [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.581907] env[70032]: DEBUG dogpile.lock [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.582035] env[70032]: DEBUG dogpile.cache.region [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.582101] env[70032]: DEBUG dogpile.lock [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.582222] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.612790] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Session token - acquiring [ 629.614521] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.614675] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.614675] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.615095] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.626030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.891380] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 629.912123] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.912268] env[70032]: DEBUG dogpile.cache.region [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Cache value generated in 0.330 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 629.912380] env[70032]: DEBUG dogpile.lock [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.912506] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Activating Policy API Provider. [ 629.912710] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Looking for the default Infrastructure Rules. [ 629.980395] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Looking for the Default Layer3 Logged Drop Section. [ 630.003066] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 630.003572] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.003750] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.003857] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.004191] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.004541] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.519185] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.021173] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.523412] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Inventory metadata is going to be refreshed. [ 631.523876] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 632.297841] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.298082] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.298169] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.298545] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.310375] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 632.418893] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.419869] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 632.438536] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.438753] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.438815] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.439134] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.439359] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.439518] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 632.439638] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 632.439747] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 632.459270] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.459472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.459619] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.459848] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.460037] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.460254] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 632.477986] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.478226] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.478321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.478610] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.478752] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.478896] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 632.496712] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.496933] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.497035] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.497276] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.497420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.497567] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 632.497675] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 632.497782] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 632.515700] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.515890] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.515987] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.516435] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.516561] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.516704] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 632.516812] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 632.516920] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 632.535477] env[70032]: DEBUG networking_nsxv3.common.locking [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.535802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.535802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.535937] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.536081] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.536225] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 632.536331] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 632.536434] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Inventory metadata have been refreshed. [ 632.536532] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Dryrun:True. Metadata refresh completed. [ 632.536649] env[70032]: DEBUG oslo_concurrency.lockutils [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Releasing lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.538255] env[70032]: INFO neutron.agent.agent_extensions_manager [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Loaded agent extensions: [] [ 632.538942] env[70032]: DEBUG neutron_lib.callbacks.manager [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70032) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 632.596425] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent RPC Daemon Started! [ 632.596641] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:0 started [ 632.596641] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent out of sync with plugin! [ 637.539454] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 637.539794] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 642.541110] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 642.541476] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 646.326698] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f85d1d5e-7804-407f-b2e3-645869b0a4e6 demo admin] Enqueued Resource ID: 89c6d9c3-1076-421c-8900-1da1d7474693 with Priority: HIGHEST for action security_group_rules [ 646.326698] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89c6d9c3-1076-421c-8900-1da1d7474693 with Priority: HIGHEST for action security_group_rules [ 646.326698] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89c6d9c3-1076-421c-8900-1da1d7474693 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.326698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89c6d9c3-1076-421c-8900-1da1d7474693" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.326698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89c6d9c3-1076-421c-8900-1da1d7474693" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.327102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89c6d9c3-1076-421c-8900-1da1d7474693" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.327102] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89c6d9c3-1076-421c-8900-1da1d7474693',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.847418] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.847665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.847665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.847823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.847915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.848032] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89c6d9c3-1076-421c-8900-1da1d7474693 already deleted. [ 646.848119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89c6d9c3-1076-421c-8900-1da1d7474693" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.327110] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 651.327423] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 656.328400] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 656.328724] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 661.330097] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 661.330554] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 662.541720] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.542130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.542130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.542266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.542427] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.046502] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.549157] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.052147] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 664.052334] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 664.787022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.787417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.787417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.787498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.797983] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 664.798849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.799655] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 664.816651] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.816809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.816907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.817219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.817219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.817365] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 664.817414] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 664.817471] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 664.834736] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.834868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.834908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.835109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.835235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.835335] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 664.853943] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.854089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.854131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.854298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.854395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.854495] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 664.870588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.870706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.870789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.870916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.871016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.871124] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 664.871197] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 664.871292] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 664.887322] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.887322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.887486] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.887535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.887582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.887788] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 664.887788] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 664.887909] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 664.905187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.905381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.905381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.905528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.905623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.905728] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 664.905800] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 664.905866] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 664.905927] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 664.906010] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 664.906076] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 664.906143] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 664.906414] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 664.906536] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 664.906536] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 664.925240] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.925369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.925405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.925572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.925668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.925777] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 664.945984] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.945984] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.945984] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.945984] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.945984] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.976253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.331854] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 666.332280] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 670.454666] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d8f7f044-4353-4a0f-8e56-7f7fb1cf2525 None None] Enqueued Resource ID: 45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b with Priority: HIGHEST for action port [ 670.454914] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b with Priority: HIGHEST for action port [ 670.455484] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.455625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.455696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.456225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.456320] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.960503] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b [ 670.960503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.960503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.960503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.960503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.960503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.960503] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b already deleted. [ 670.960503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45d3eb2d-b1ed-4930-aefc-b44b6fd59c3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.383808] env[70032]: INFO networking_nsxv3.common.synchronization [None req-e3be9401-da82-4302-93ec-1706a8fe99d2 None None] Enqueued Resource ID: fd30e525-3ecd-4d07-b87d-4fa33788ccdc with Priority: HIGHEST for action port [ 671.384097] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd30e525-3ecd-4d07-b87d-4fa33788ccdc with Priority: HIGHEST for action port [ 671.384631] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd30e525-3ecd-4d07-b87d-4fa33788ccdc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.384863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd30e525-3ecd-4d07-b87d-4fa33788ccdc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.384863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd30e525-3ecd-4d07-b87d-4fa33788ccdc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.385680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd30e525-3ecd-4d07-b87d-4fa33788ccdc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.385804] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd30e525-3ecd-4d07-b87d-4fa33788ccdc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.891161] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd30e525-3ecd-4d07-b87d-4fa33788ccdc [ 671.891444] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.894061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.894061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.894061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.894061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.894061] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd30e525-3ecd-4d07-b87d-4fa33788ccdc already deleted. [ 671.894061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd30e525-3ecd-4d07-b87d-4fa33788ccdc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.123730] env[70032]: INFO networking_nsxv3.common.synchronization [None req-85d91826-a6fa-4483-9811-3e47a59bb001 None None] Enqueued Resource ID: 6bb555ec-531a-44f4-9d2d-ff992ee44cf4 with Priority: HIGHEST for action port [ 672.123730] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb555ec-531a-44f4-9d2d-ff992ee44cf4 with Priority: HIGHEST for action port [ 672.125196] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb555ec-531a-44f4-9d2d-ff992ee44cf4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.125407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb555ec-531a-44f4-9d2d-ff992ee44cf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.125407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb555ec-531a-44f4-9d2d-ff992ee44cf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.125665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb555ec-531a-44f4-9d2d-ff992ee44cf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.125749] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb555ec-531a-44f4-9d2d-ff992ee44cf4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.628624] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bb555ec-531a-44f4-9d2d-ff992ee44cf4 [ 672.628744] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.628836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.628917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.629130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.629228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.629325] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bb555ec-531a-44f4-9d2d-ff992ee44cf4 already deleted. [ 672.629407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb555ec-531a-44f4-9d2d-ff992ee44cf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.761189] env[70032]: INFO networking_nsxv3.common.synchronization [None req-58357d64-64d7-49e0-b686-ab0fb3a70e70 None None] Enqueued Resource ID: caa20630-a772-4771-8323-47fdc17cb620 with Priority: HIGHEST for action port [ 672.761189] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa20630-a772-4771-8323-47fdc17cb620 with Priority: HIGHEST for action port [ 672.761189] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-caa20630-a772-4771-8323-47fdc17cb620 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.761189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-caa20630-a772-4771-8323-47fdc17cb620" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.761189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-caa20630-a772-4771-8323-47fdc17cb620" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.761189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-caa20630-a772-4771-8323-47fdc17cb620" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.761189] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caa20630-a772-4771-8323-47fdc17cb620',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.041326] env[70032]: INFO networking_nsxv3.common.synchronization [None req-630f31e4-4b5b-48e7-96d5-73f96badfaee None None] Enqueued Resource ID: 6e52c0ba-25c3-45b3-b9cf-56a793434cdb with Priority: HIGHEST for action port [ 673.041692] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e52c0ba-25c3-45b3-b9cf-56a793434cdb with Priority: HIGHEST for action port [ 673.041986] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e52c0ba-25c3-45b3-b9cf-56a793434cdb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.042124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e52c0ba-25c3-45b3-b9cf-56a793434cdb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.042194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e52c0ba-25c3-45b3-b9cf-56a793434cdb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.042431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e52c0ba-25c3-45b3-b9cf-56a793434cdb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.042512] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e52c0ba-25c3-45b3-b9cf-56a793434cdb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.266212] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port caa20630-a772-4771-8323-47fdc17cb620 [ 673.266212] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.266212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.266212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.266212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.266212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.266212] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:caa20630-a772-4771-8323-47fdc17cb620 already deleted. [ 673.266212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-caa20630-a772-4771-8323-47fdc17cb620" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.548389] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e52c0ba-25c3-45b3-b9cf-56a793434cdb [ 673.548630] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.548769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.548842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.549074] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.549171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.549270] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e52c0ba-25c3-45b3-b9cf-56a793434cdb already deleted. [ 673.549354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e52c0ba-25c3-45b3-b9cf-56a793434cdb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.988983] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c55fe8d5-be06-4193-8bde-ea1d5ddc6b1a tempest-ServersTestJSON-1822060144 tempest-ServersTestJSON-1822060144-project-member] Enqueued Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_rules [ 673.989521] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_rules [ 673.991022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.991022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.991022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.991022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.991022] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.055329] env[70032]: INFO networking_nsxv3.common.synchronization [None req-873b67f9-2a26-4b8b-9ca6-338d24939f05 tempest-ServersTestJSON-1822060144 tempest-ServersTestJSON-1822060144-project-member] Enqueued Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_rules [ 674.055577] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_rules [ 674.056125] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.056360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.515116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.515116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.515116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.515116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.515116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.515116] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 already deleted. [ 674.515116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.515116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.515116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.515116] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.034919] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.035104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.035104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.035273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.035497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.035531] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 already deleted. [ 675.035616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.189756] env[70032]: INFO networking_nsxv3.common.synchronization [None req-4cda7fc0-b47a-43a2-8275-6af64be188b8 None None] Enqueued Resource ID: d4dd85ab-0409-4bbf-b1ab-58780a57f26b with Priority: HIGHEST for action port [ 675.190035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd85ab-0409-4bbf-b1ab-58780a57f26b with Priority: HIGHEST for action port [ 675.190596] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4dd85ab-0409-4bbf-b1ab-58780a57f26b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.190716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4dd85ab-0409-4bbf-b1ab-58780a57f26b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.190759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4dd85ab-0409-4bbf-b1ab-58780a57f26b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.191160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4dd85ab-0409-4bbf-b1ab-58780a57f26b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.191421] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4dd85ab-0409-4bbf-b1ab-58780a57f26b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.692981] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4dd85ab-0409-4bbf-b1ab-58780a57f26b [ 675.693241] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.693347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.693401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.693637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.693762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.694447] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4dd85ab-0409-4bbf-b1ab-58780a57f26b already deleted. [ 675.694447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4dd85ab-0409-4bbf-b1ab-58780a57f26b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.932434] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d4c00dfc-8e3a-4701-b229-aed2d990c80c None None] Enqueued Resource ID: deb0f1ab-8990-4161-820c-39d2c776dce8 with Priority: HIGHEST for action port [ 675.932434] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb0f1ab-8990-4161-820c-39d2c776dce8 with Priority: HIGHEST for action port [ 675.932896] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-deb0f1ab-8990-4161-820c-39d2c776dce8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.933030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deb0f1ab-8990-4161-820c-39d2c776dce8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.933117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deb0f1ab-8990-4161-820c-39d2c776dce8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.933334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deb0f1ab-8990-4161-820c-39d2c776dce8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.933411] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deb0f1ab-8990-4161-820c-39d2c776dce8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.439129] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deb0f1ab-8990-4161-820c-39d2c776dce8 [ 676.439129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.439129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.439129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.439129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.439129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.439129] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deb0f1ab-8990-4161-820c-39d2c776dce8 already deleted. [ 676.439129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deb0f1ab-8990-4161-820c-39d2c776dce8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.727224] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8d756568-9efa-482a-90cb-dac4bb184304 None None] Enqueued Resource ID: ed5ce937-da2a-41e6-905d-20ce562c6708 with Priority: HIGHEST for action port [ 676.731174] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5ce937-da2a-41e6-905d-20ce562c6708 with Priority: HIGHEST for action port [ 676.731361] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed5ce937-da2a-41e6-905d-20ce562c6708 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.731653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed5ce937-da2a-41e6-905d-20ce562c6708" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.731757] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed5ce937-da2a-41e6-905d-20ce562c6708" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.732080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed5ce937-da2a-41e6-905d-20ce562c6708" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.732194] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed5ce937-da2a-41e6-905d-20ce562c6708',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.073732] env[70032]: INFO networking_nsxv3.common.synchronization [None req-3cc8a191-830e-45e0-99ca-258c2e16de60 None None] Enqueued Resource ID: 0e25d7c7-fc38-4183-b8a6-3ac32d2ba436 with Priority: HIGHEST for action port [ 677.077032] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e25d7c7-fc38-4183-b8a6-3ac32d2ba436 with Priority: HIGHEST for action port [ 677.077032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e25d7c7-fc38-4183-b8a6-3ac32d2ba436 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.077032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e25d7c7-fc38-4183-b8a6-3ac32d2ba436" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.077032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e25d7c7-fc38-4183-b8a6-3ac32d2ba436" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.077032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e25d7c7-fc38-4183-b8a6-3ac32d2ba436" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.077032] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e25d7c7-fc38-4183-b8a6-3ac32d2ba436',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.235572] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed5ce937-da2a-41e6-905d-20ce562c6708 [ 677.235572] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.236235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.236339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.237448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.237448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.237448] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed5ce937-da2a-41e6-905d-20ce562c6708 already deleted. [ 677.237448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed5ce937-da2a-41e6-905d-20ce562c6708" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.379021] env[70032]: INFO networking_nsxv3.common.synchronization [None req-135742d8-a9e6-4121-a40e-4183c3e4b27a None None] Enqueued Resource ID: 2efc7c66-12c4-4009-be2e-a1e6a356a8e5 with Priority: HIGHEST for action port [ 677.379021] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efc7c66-12c4-4009-be2e-a1e6a356a8e5 with Priority: HIGHEST for action port [ 677.379021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2efc7c66-12c4-4009-be2e-a1e6a356a8e5 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.379021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2efc7c66-12c4-4009-be2e-a1e6a356a8e5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.379021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2efc7c66-12c4-4009-be2e-a1e6a356a8e5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.379021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2efc7c66-12c4-4009-be2e-a1e6a356a8e5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.379021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2efc7c66-12c4-4009-be2e-a1e6a356a8e5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.580073] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e25d7c7-fc38-4183-b8a6-3ac32d2ba436 [ 677.580073] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.580073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.580073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.580073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.580073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.580073] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e25d7c7-fc38-4183-b8a6-3ac32d2ba436 already deleted. [ 677.580073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e25d7c7-fc38-4183-b8a6-3ac32d2ba436" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.816862] env[70032]: INFO networking_nsxv3.common.synchronization [None req-34431c0e-fea0-45f1-8cbf-717746a9de34 None None] Enqueued Resource ID: 6326e09e-5d32-4e28-91c1-a86397fda2ae with Priority: HIGHEST for action port [ 677.818159] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326e09e-5d32-4e28-91c1-a86397fda2ae with Priority: HIGHEST for action port [ 677.822143] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6326e09e-5d32-4e28-91c1-a86397fda2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.822821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6326e09e-5d32-4e28-91c1-a86397fda2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.822893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6326e09e-5d32-4e28-91c1-a86397fda2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.823190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6326e09e-5d32-4e28-91c1-a86397fda2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.824348] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6326e09e-5d32-4e28-91c1-a86397fda2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.881974] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2efc7c66-12c4-4009-be2e-a1e6a356a8e5 [ 677.882275] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.882446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.882548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.882879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.882879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.885884] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2efc7c66-12c4-4009-be2e-a1e6a356a8e5 already deleted. [ 677.885884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2efc7c66-12c4-4009-be2e-a1e6a356a8e5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.327100] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6326e09e-5d32-4e28-91c1-a86397fda2ae [ 678.327100] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.327305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.327305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.327498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.327578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.327681] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6326e09e-5d32-4e28-91c1-a86397fda2ae already deleted. [ 678.327769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6326e09e-5d32-4e28-91c1-a86397fda2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.040494] env[70032]: INFO networking_nsxv3.common.synchronization [None req-fe9130ca-6436-47a2-a0c9-77c134338556 None None] Enqueued Resource ID: 4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2 with Priority: HIGHEST for action port [ 679.040778] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2 with Priority: HIGHEST for action port [ 679.041329] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.041462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.041541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.041790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.041871] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.546932] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2 [ 679.548675] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.548675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.548675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.548675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.548675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.548675] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2 already deleted. [ 679.548675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ad04dc3-ca7f-4dae-8876-fc4cec3b81a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.584707] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ed0f0e24-2683-4c43-8f25-bc7eeb27d905 None None] Enqueued Resource ID: f91bcf36-9c78-45a9-a326-110a432d131c with Priority: HIGHEST for action port [ 679.584955] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f91bcf36-9c78-45a9-a326-110a432d131c with Priority: HIGHEST for action port [ 679.586331] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f91bcf36-9c78-45a9-a326-110a432d131c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.586331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f91bcf36-9c78-45a9-a326-110a432d131c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.586331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f91bcf36-9c78-45a9-a326-110a432d131c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.586331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f91bcf36-9c78-45a9-a326-110a432d131c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.586331] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91bcf36-9c78-45a9-a326-110a432d131c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.088911] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f91bcf36-9c78-45a9-a326-110a432d131c [ 680.089388] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.089388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.089388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.089581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.089830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.089830] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f91bcf36-9c78-45a9-a326-110a432d131c already deleted. [ 680.089830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f91bcf36-9c78-45a9-a326-110a432d131c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.271861] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d0536389-9ccd-448c-8a77-86ecadb9c56a None None] Enqueued Resource ID: 00e0a3b2-adc3-44b0-957c-9e0a33345aba with Priority: HIGHEST for action port [ 680.272149] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e0a3b2-adc3-44b0-957c-9e0a33345aba with Priority: HIGHEST for action port [ 680.272540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-00e0a3b2-adc3-44b0-957c-9e0a33345aba taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.272914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00e0a3b2-adc3-44b0-957c-9e0a33345aba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.272914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00e0a3b2-adc3-44b0-957c-9e0a33345aba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.272914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00e0a3b2-adc3-44b0-957c-9e0a33345aba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.273036] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00e0a3b2-adc3-44b0-957c-9e0a33345aba',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.775665] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00e0a3b2-adc3-44b0-957c-9e0a33345aba [ 680.775922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.776060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.776122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.776346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.776435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.776530] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00e0a3b2-adc3-44b0-957c-9e0a33345aba already deleted. [ 680.776632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00e0a3b2-adc3-44b0-957c-9e0a33345aba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.925143] env[70032]: INFO networking_nsxv3.common.synchronization [None req-53b4641a-a015-4eee-b2c5-2acbbfa78960 None None] Enqueued Resource ID: 1ea01181-ae7a-4df9-ad01-8f90b970ab82 with Priority: HIGHEST for action port [ 680.925537] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ea01181-ae7a-4df9-ad01-8f90b970ab82 with Priority: HIGHEST for action port [ 680.925889] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ea01181-ae7a-4df9-ad01-8f90b970ab82 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.926040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ea01181-ae7a-4df9-ad01-8f90b970ab82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.926089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ea01181-ae7a-4df9-ad01-8f90b970ab82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.927206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ea01181-ae7a-4df9-ad01-8f90b970ab82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.927386] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ea01181-ae7a-4df9-ad01-8f90b970ab82',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.431340] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ea01181-ae7a-4df9-ad01-8f90b970ab82 [ 681.431623] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.431745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.431818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.432047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.432148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.432247] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ea01181-ae7a-4df9-ad01-8f90b970ab82 already deleted. [ 681.432331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ea01181-ae7a-4df9-ad01-8f90b970ab82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.491152] env[70032]: INFO networking_nsxv3.common.synchronization [None req-16a740c4-0529-4dfa-a243-bf2f3d0006cb None None] Enqueued Resource ID: b98f5249-b0f6-4cb6-986f-0abd92009f80 with Priority: HIGHEST for action port [ 681.493339] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b98f5249-b0f6-4cb6-986f-0abd92009f80 with Priority: HIGHEST for action port [ 681.493339] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b98f5249-b0f6-4cb6-986f-0abd92009f80 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.493339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b98f5249-b0f6-4cb6-986f-0abd92009f80" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.493339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b98f5249-b0f6-4cb6-986f-0abd92009f80" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.493339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b98f5249-b0f6-4cb6-986f-0abd92009f80" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.493339] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b98f5249-b0f6-4cb6-986f-0abd92009f80',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.995530] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b98f5249-b0f6-4cb6-986f-0abd92009f80 [ 681.996519] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.996519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.996519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.996519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.996519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.996519] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b98f5249-b0f6-4cb6-986f-0abd92009f80 already deleted. [ 681.996519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b98f5249-b0f6-4cb6-986f-0abd92009f80" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.470201] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1a4e4a35-f79d-4f33-ac6d-6dde66602424 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_rules [ 682.472676] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_rules [ 682.472676] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.472676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.472676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.475111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.475225] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.651895] env[70032]: INFO networking_nsxv3.common.synchronization [None req-3b94884b-14b5-497a-89f4-25c71cf548cc tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_rules [ 682.652164] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_rules [ 682.652700] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.652808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.000202] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.000202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.000202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.000202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.000202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.000202] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 already deleted. [ 683.000202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.000202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.000202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.000202] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.520115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.520382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.520382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.520550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.520630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.520692] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 already deleted. [ 683.520780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.219974] env[70032]: INFO networking_nsxv3.common.synchronization [req-51ea339b-933e-47df-b9f8-fa685675d061 req-fa0aacd7-1d1c-4b28-8738-a13530769ce6 tempest-FloatingIPsAssociationNegativeTestJSON-111942885 tempest-FloatingIPsAssociationNegativeTestJSON-111942885-project-member] Enqueued Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_members [ 684.220450] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_members [ 684.220757] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.220879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.220949] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.221321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.221490] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.221630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.221686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.221848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.221936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.222044] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.727329] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.727329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.727329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.727703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.727703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.727764] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.728355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.728355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.728355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.728355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.728355] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61533d93-47dd-40b4-b191-9d366077f93c already deleted. [ 684.728355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.912989] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-101 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.913971] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-101" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.913971] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-101" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.918019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-101" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.918019] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.918019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.918019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.918019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.918019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.918019] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.918019] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.918019] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.918019] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.918019] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 684.918019] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.918019] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.934602] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.934602] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 684.934602] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.934602] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-101" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.934602] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-4b92da63-9378-4b77-be55-804ed905b9b9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.934602] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.934602] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.935366] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.935366] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b92da63-9378-4b77-be55-804ed905b9b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.013155] env[70032]: INFO networking_nsxv3.common.synchronization [None req-361fceb6-f29c-4feb-9fd3-fa18464e0d63 None None] Enqueued Resource ID: c04e500a-7190-4b83-815f-97911d4cead3 with Priority: HIGHEST for action port [ 685.013155] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04e500a-7190-4b83-815f-97911d4cead3 with Priority: HIGHEST for action port [ 685.013337] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-c04e500a-7190-4b83-815f-97911d4cead3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.014251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c04e500a-7190-4b83-815f-97911d4cead3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.014251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c04e500a-7190-4b83-815f-97911d4cead3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.015485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c04e500a-7190-4b83-815f-97911d4cead3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.015485] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c04e500a-7190-4b83-815f-97911d4cead3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.441225] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.441495] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.441926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.441926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.442105] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.442259] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 4b92da63-9378-4b77-be55-804ed905b9b9 not found, creating... [ 685.443684] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.443684] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.443684] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.443684] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.443684] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.443684] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.443996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.443996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.445092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.445092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.445092] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 4b92da63-9378-4b77-be55-804ed905b9b9 is going to be created. [ 685.469404] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.469609] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.469733] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.470014] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.470241] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.470456] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.518888] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c04e500a-7190-4b83-815f-97911d4cead3 [ 685.519090] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.519200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.519272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.519489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.519601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.519694] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c04e500a-7190-4b83-815f-97911d4cead3 already deleted. [ 685.519880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c04e500a-7190-4b83-815f-97911d4cead3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.729027] env[70032]: INFO networking_nsxv3.common.synchronization [None req-028a07b1-886b-4903-8d30-a46c4f8a5f67 None None] Enqueued Resource ID: 5c8715c1-1f61-40cb-9e1b-d779b7e8f81d with Priority: HIGHEST for action port [ 685.729292] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c8715c1-1f61-40cb-9e1b-d779b7e8f81d with Priority: HIGHEST for action port [ 685.729866] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c8715c1-1f61-40cb-9e1b-d779b7e8f81d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.729949] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c8715c1-1f61-40cb-9e1b-d779b7e8f81d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.730361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c8715c1-1f61-40cb-9e1b-d779b7e8f81d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.730361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c8715c1-1f61-40cb-9e1b-d779b7e8f81d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.730361] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c8715c1-1f61-40cb-9e1b-d779b7e8f81d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.746429] env[70032]: INFO networking_nsxv3.common.synchronization [req-a0ead6b1-8942-4d52-81da-2bece8ab300a req-4138af1a-5308-4ad2-a80b-0fbc50b8e045 tempest-ServersTestJSON-1822060144 tempest-ServersTestJSON-1822060144-project-member] Enqueued Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_members [ 685.746429] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_members [ 685.746429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.746429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.746429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.746429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.746429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.746429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.746429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.746429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.746429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.746429] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.083698] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b1c49981-7cc5-49c2-b2f2-1049860c5f85 None None] Enqueued Resource ID: 38b5d7ea-664c-4838-8ee4-6b3e0a30e822 with Priority: HIGHEST for action port [ 686.084688] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b5d7ea-664c-4838-8ee4-6b3e0a30e822 with Priority: HIGHEST for action port [ 686.085312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-38b5d7ea-664c-4838-8ee4-6b3e0a30e822 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.085429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38b5d7ea-664c-4838-8ee4-6b3e0a30e822" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.085580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38b5d7ea-664c-4838-8ee4-6b3e0a30e822" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.086540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38b5d7ea-664c-4838-8ee4-6b3e0a30e822" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.086540] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b5d7ea-664c-4838-8ee4-6b3e0a30e822',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.110424] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.110629] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-784" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.110779] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-784" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.111108] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-784" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.111405] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.111585] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.111716] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.112115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.112525] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.112759] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.112882] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.112999] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.113126] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.113246] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.113518] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.113518] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.130264] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.130420] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.130561] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.131089] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-784" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.131089] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-269e588c-8163-4fd1-81c3-42cb470eee4d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.131820] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.132112] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.132342] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.132507] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269e588c-8163-4fd1-81c3-42cb470eee4d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.233064] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c8715c1-1f61-40cb-9e1b-d779b7e8f81d [ 686.233362] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.233458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.233529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.233797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.233892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.233991] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c8715c1-1f61-40cb-9e1b-d779b7e8f81d already deleted. [ 686.234090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c8715c1-1f61-40cb-9e1b-d779b7e8f81d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.249635] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.249777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.249858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.250068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.250168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.250361] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.250464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.250526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.250680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.250761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.250847] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 already deleted. [ 686.250928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.588803] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38b5d7ea-664c-4838-8ee4-6b3e0a30e822 [ 686.589075] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.589250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.589320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.589524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.589621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.589737] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38b5d7ea-664c-4838-8ee4-6b3e0a30e822 already deleted. [ 686.589827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38b5d7ea-664c-4838-8ee4-6b3e0a30e822" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.636536] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.636772] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.636903] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.637200] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.637462] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.637530] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 269e588c-8163-4fd1-81c3-42cb470eee4d not found, creating... [ 686.637833] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.638009] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.638135] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.638354] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.638492] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.638770] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.638925] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.639516] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.639764] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.639913] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.640086] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 269e588c-8163-4fd1-81c3-42cb470eee4d is going to be created. [ 686.659842] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.660193] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.660330] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.660597] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.660821] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.661053] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.813849] env[70032]: INFO networking_nsxv3.common.synchronization [req-51ea339b-933e-47df-b9f8-fa685675d061 req-0c19ff99-281b-4c87-8a26-6f0d530c5ee9 service nova] Enqueued Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_rules [ 686.814342] env[70032]: INFO networking_nsxv3.common.synchronization [req-51ea339b-933e-47df-b9f8-fa685675d061 req-0c19ff99-281b-4c87-8a26-6f0d530c5ee9 service nova] Enqueued Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_members [ 686.814342] env[70032]: INFO networking_nsxv3.common.synchronization [req-51ea339b-933e-47df-b9f8-fa685675d061 req-0c19ff99-281b-4c87-8a26-6f0d530c5ee9 service nova] Enqueued Resource ID: 4b92da63-9378-4b77-be55-804ed905b9b9 with Priority: HIGHEST for action port [ 686.814557] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_rules [ 686.814557] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_members [ 686.814813] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b92da63-9378-4b77-be55-804ed905b9b9 with Priority: HIGHEST for action port [ 686.816620] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.816620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.816620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.816620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.816912] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.817598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.817598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.817785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.820050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.820050] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.820050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.820050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.820050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.820050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.820050] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.821389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b92da63-9378-4b77-be55-804ed905b9b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.821493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.821632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.821880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.822113] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b92da63-9378-4b77-be55-804ed905b9b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.324504] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.326046] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.326046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.338281] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b92da63-9378-4b77-be55-804ed905b9b9 with status ACTIVE [ 687.338502] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.338634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.338725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.338917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.338997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.339184] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.339280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.339343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.339503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.339583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.339761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.339856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.339918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.340069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.340145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.340229] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b92da63-9378-4b77-be55-804ed905b9b9 is going to be updated. [ 687.367625] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.367625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.368559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.368559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.368559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.368559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b92da63-9378-4b77-be55-804ed905b9b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.549843] env[70032]: INFO networking_nsxv3.common.synchronization [req-a0ead6b1-8942-4d52-81da-2bece8ab300a req-719f0c5f-a5c4-4131-aeed-78643a1bad93 service nova] Enqueued Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_rules [ 687.550041] env[70032]: INFO networking_nsxv3.common.synchronization [req-a0ead6b1-8942-4d52-81da-2bece8ab300a req-719f0c5f-a5c4-4131-aeed-78643a1bad93 service nova] Enqueued Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_members [ 687.550177] env[70032]: INFO networking_nsxv3.common.synchronization [req-a0ead6b1-8942-4d52-81da-2bece8ab300a req-719f0c5f-a5c4-4131-aeed-78643a1bad93 service nova] Enqueued Resource ID: 269e588c-8163-4fd1-81c3-42cb470eee4d with Priority: HIGHEST for action port [ 687.550875] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_rules [ 687.550875] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_members [ 687.550875] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 269e588c-8163-4fd1-81c3-42cb470eee4d with Priority: HIGHEST for action port [ 687.551129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.551249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.551312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.551499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.551574] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.552841] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.552841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.552841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.552841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.553071] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.553116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.553147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.553305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.553390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.553476] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.554192] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-269e588c-8163-4fd1-81c3-42cb470eee4d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.554299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.554379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.554875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.554875] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269e588c-8163-4fd1-81c3-42cb470eee4d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.828386] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.983730] env[70032]: INFO networking_nsxv3.common.synchronization [req-112c45ed-c8ee-4f58-9c27-3bf77c24cb67 req-90210031-63fb-45ae-ba40-23e79fb822b8 tempest-ServerExternalEventsTest-1522446835 tempest-ServerExternalEventsTest-1522446835-project-member] Enqueued Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_members [ 687.983730] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_members [ 687.983730] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.983730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.983730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.983730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.983730] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.983730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.983999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.984449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.984449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.984449] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.058497] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.058497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.058497] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 269e588c-8163-4fd1-81c3-42cb470eee4d with status ACTIVE [ 688.058497] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.058497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.058497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 269e588c-8163-4fd1-81c3-42cb470eee4d is going to be updated. [ 688.063513] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.088658] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.088658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.088658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.088658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.088658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.088658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-269e588c-8163-4fd1-81c3-42cb470eee4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.331900] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.332112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.332145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.332353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.332569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.332569] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61533d93-47dd-40b4-b191-9d366077f93c is going to be created. [ 688.403215] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.403411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.403507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.403830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.404048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.413490] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61533d93-47dd-40b4-b191-9d366077f93c in Status: UNINITIALIZED for 2s [ 688.436033] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.436033] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.436033] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.436379] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.436440] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.436631] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.436716] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.436934] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.437365] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.438287] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.438448] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.438589] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.438740] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.438906] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.439060] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.439233] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.463433] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.465073] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.465073] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.465317] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.466910] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.466910] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.467079] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.467306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.467636] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db1d89cf-ff3a-461f-8a9f-2fdb92e2a628',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.486452] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.486603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.486666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.486881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.487039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.487176] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.487268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.487327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.487479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.487567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.487653] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f87689-4053-460b-b9e6-259755632006 already deleted. [ 688.487731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.566468] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.873280] env[70032]: INFO networking_nsxv3.common.synchronization [None req-5f8fda1a-b9d6-4465-95dc-ea8f21b4f5d4 None None] Enqueued Resource ID: 7283b136-43d8-45bc-b443-f275fea6b8a8 with Priority: HIGHEST for action port [ 688.873835] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7283b136-43d8-45bc-b443-f275fea6b8a8 with Priority: HIGHEST for action port [ 688.874304] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7283b136-43d8-45bc-b443-f275fea6b8a8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.874304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7283b136-43d8-45bc-b443-f275fea6b8a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.874403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7283b136-43d8-45bc-b443-f275fea6b8a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.879615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7283b136-43d8-45bc-b443-f275fea6b8a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.879769] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7283b136-43d8-45bc-b443-f275fea6b8a8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.970706] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.970946] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.971106] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.971445] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.971552] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.971754] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 not found, creating... [ 688.972021] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.972192] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.972322] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.972621] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.972754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.973148] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.973360] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.973506] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.973770] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.973926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.974096] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 is going to be created. [ 688.992420] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.992611] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.992734] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.993034] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.993277] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.993741] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069127] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.069329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.069579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.070727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.070727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.070820] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 is going to be created. [ 689.101313] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.101313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.101313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.101313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.101313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.113420] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 in Status: UNINITIALIZED for 2s [ 689.383012] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7283b136-43d8-45bc-b443-f275fea6b8a8 [ 689.383473] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.383473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.383633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.383827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.383882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.383958] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7283b136-43d8-45bc-b443-f275fea6b8a8 already deleted. [ 689.384099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7283b136-43d8-45bc-b443-f275fea6b8a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.894410] env[70032]: INFO networking_nsxv3.common.synchronization [req-112c45ed-c8ee-4f58-9c27-3bf77c24cb67 req-d087ed82-78b8-456c-ae4c-0d7b0971e23f service nova] Enqueued Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_rules [ 689.894724] env[70032]: INFO networking_nsxv3.common.synchronization [req-112c45ed-c8ee-4f58-9c27-3bf77c24cb67 req-d087ed82-78b8-456c-ae4c-0d7b0971e23f service nova] Enqueued Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_members [ 689.894724] env[70032]: INFO networking_nsxv3.common.synchronization [req-112c45ed-c8ee-4f58-9c27-3bf77c24cb67 req-d087ed82-78b8-456c-ae4c-0d7b0971e23f service nova] Enqueued Resource ID: db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 with Priority: HIGHEST for action port [ 689.897700] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_rules [ 689.897764] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_members [ 689.898385] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 with Priority: HIGHEST for action port [ 689.898385] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.898545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.898545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.898763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.898876] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.899836] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.899954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.900043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.901117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.902316] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.902316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.902470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.902660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.903171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.903368] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.906453] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.906692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.906760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.907155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.907155] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db1d89cf-ff3a-461f-8a9f-2fdb92e2a628',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.411233] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.414405] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.414405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.414405] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 with status ACTIVE [ 690.414405] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.414405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.414405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.416634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.416634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.416634] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.416634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.416634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.416634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.416634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.417054] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.417054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.417054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.417054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.417461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.418250] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db1d89cf-ff3a-461f-8a9f-2fdb92e2a628 is going to be updated. [ 690.438701] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61533d93-47dd-40b4-b191-9d366077f93c in Status: SUCCESS [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.438701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438701] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.441140] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.441591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.441591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.441843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.442153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.442404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db1d89cf-ff3a-461f-8a9f-2fdb92e2a628" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.500838] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f5727c3-e07e-44c2-abc9-cbff9d50285d req-bfc32036-5424-4647-8a28-71615bdf328a tempest-DeleteServersAdminTestJSON-623582194 tempest-DeleteServersAdminTestJSON-623582194-project-member] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 690.504156] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 690.504989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.505134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.505224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.505497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.505657] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.505760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.505826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.505979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.506182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.506182] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.921622] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.942558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.942558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.942558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.942558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.943065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.943152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.946170] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.946170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.946170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.946170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.946170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.946170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.946170] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.997343] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.997656] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.997844] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.998173] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.998457] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.998619] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.998734] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.999041] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.999221] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.999427] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.001024] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.001024] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.001024] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.001024] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.001024] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.001807] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.010921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.011098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.011186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.011408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.011501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.011694] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.011794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.011857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.012027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.012373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.012373] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 already deleted. [ 691.012373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.020895] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.021172] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 691.022319] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.022555] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.022933] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-d0168fb6-c389-4403-b785-bb2fdaa18866 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.023148] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.023288] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.023602] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.023776] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0168fb6-c389-4403-b785-bb2fdaa18866',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.124874] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 in Status: SUCCESS [ 691.125253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.125341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.125554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.125752] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.125951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.126022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.126260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.126365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.126490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.126558] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.427064] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.427064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.427064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.427064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.427064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.427064] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f87689-4053-460b-b9e6-259755632006 is going to be created. [ 691.447953] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.448387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.448901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.449260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.449605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.453863] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61533d93-47dd-40b4-b191-9d366077f93c: rpc.has_security_group_logging(os_id): False [ 691.467896] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f87689-4053-460b-b9e6-259755632006 in Status: UNINITIALIZED for 2s [ 691.473678] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.473678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.473784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.474015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.474116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.474347] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.474454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.474515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.474886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.474886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.474977] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.475059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.475091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.475267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.475321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.475466] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.475553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.475610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.475745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.475814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.475902] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61533d93-47dd-40b4-b191-9d366077f93c is going to be created. [ 691.530719] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.530719] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port d0168fb6-c389-4403-b785-bb2fdaa18866 not found, creating... [ 691.530719] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.530719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.531803] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.532136] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.532464] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.532863] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.533127] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.533374] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: d0168fb6-c389-4403-b785-bb2fdaa18866 is going to be created. [ 691.542209] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.542209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.542209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.542209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.542209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.550602] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61533d93-47dd-40b4-b191-9d366077f93c in Status: IN_PROGRESS for 2s [ 691.556958] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.557183] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.557312] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.557564] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.557783] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.558013] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.630970] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.633256] env[70032]: INFO networking_nsxv3.common.synchronization [None req-648da572-fe28-40d6-acdf-c3e56b412532 tempest-ServersWithSpecificFlavorTestJSON-1841008358 tempest-ServersWithSpecificFlavorTestJSON-1841008358-project-member] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 691.634131] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 691.634181] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.634393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.634393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.634595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.634672] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.748674] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f8c4a07c-85f2-487d-9a39-917ce2a8a7e1 tempest-ServersWithSpecificFlavorTestJSON-1841008358 tempest-ServersWithSpecificFlavorTestJSON-1841008358-project-member] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 691.748674] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 691.748674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.748674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.137248] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95997ae8-ded3-4f2f-85bd-5d180ad401b9: rpc.has_security_group_logging(os_id): False [ 692.154035] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.154327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.154327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.154455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.154696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.154696] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef already deleted. [ 692.154884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.154941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.155075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.155156] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.156842] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.156992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.157116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.157298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.157298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.157554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.157650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.157732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.157836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.157915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.158014] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 is going to be created. [ 692.232897] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.233127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.233171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.233386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.233562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.267636] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 in Status: IN_PROGRESS for 2s [ 692.678234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.678234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.678234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.678234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.678234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.678234] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef already deleted. [ 692.678234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.701527] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f5727c3-e07e-44c2-abc9-cbff9d50285d req-9b7499ad-3976-4040-9305-842cbefcdb7f service nova] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_rules [ 692.701803] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f5727c3-e07e-44c2-abc9-cbff9d50285d req-9b7499ad-3976-4040-9305-842cbefcdb7f service nova] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 692.701873] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f5727c3-e07e-44c2-abc9-cbff9d50285d req-9b7499ad-3976-4040-9305-842cbefcdb7f service nova] Enqueued Resource ID: d0168fb6-c389-4403-b785-bb2fdaa18866 with Priority: HIGHEST for action port [ 692.702127] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_rules [ 692.702236] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 692.702333] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0168fb6-c389-4403-b785-bb2fdaa18866 with Priority: HIGHEST for action port [ 692.704133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.704270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.704333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.704580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.704662] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.705665] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.705665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.705665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.705962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.705962] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.706898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.706898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.706898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.706898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.707158] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.708068] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0168fb6-c389-4403-b785-bb2fdaa18866 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.708068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.708068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.708268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.708316] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0168fb6-c389-4403-b785-bb2fdaa18866',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.210715] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.211183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.211355] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.214167] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0168fb6-c389-4403-b785-bb2fdaa18866 with status ACTIVE [ 693.214167] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.214167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.214167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.214466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.214635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.214983] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.215119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.215184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.215496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.215496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.217861] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.217861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.217861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.217861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.217861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.217861] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0168fb6-c389-4403-b785-bb2fdaa18866 is going to be updated. [ 693.241245] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.241685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.241752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.241990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.242354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.242354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0168fb6-c389-4403-b785-bb2fdaa18866" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.476767] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f87689-4053-460b-b9e6-259755632006 in Status: SUCCESS [ 693.476979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.477161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.477424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.477546] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.477763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.477763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.477877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.477945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.478040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.478123] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.561438] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61533d93-47dd-40b4-b191-9d366077f93c in Status: SUCCESS [ 693.562122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.624023] env[70032]: INFO networking_nsxv3.common.synchronization [req-7bb7ec50-5d57-4e6f-9f65-25ee489a875f req-a277fc1e-936b-42ea-b751-e30863b5f93f tempest-ServerDiagnosticsTest-1474316937 tempest-ServerDiagnosticsTest-1474316937-project-member] Enqueued Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_members [ 693.624023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_members [ 693.624023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.624023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.624023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.627717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.627717] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.627717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.627717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.627717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.627717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.627717] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.718740] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.984230] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.984230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.984230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.984862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.984862] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.984862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.984862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.984862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.984862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.985084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.985123] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.985209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.985266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.985415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.985568] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.985660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.985722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.985856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.985931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.986044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.986138] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.130856] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.130856] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.130856] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 already deleted. [ 694.130856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.221348] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.222252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.224956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.224956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.224956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.224956] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 is going to be created. [ 694.249841] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.249841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.249841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.250021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.250226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.261985] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: UNINITIALIZED for 2s [ 694.281819] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 in Status: SUCCESS [ 694.281819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.489709] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f87689-4053-460b-b9e6-259755632006: rpc.has_security_group_logging(os_id): False [ 694.524431] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.524594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.524594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.524856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.524951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.525168] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.525415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.525415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.525549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.525549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.525809] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.525809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.526027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.526027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.526120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.526324] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.526405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.526471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.526628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.526710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.526784] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f87689-4053-460b-b9e6-259755632006 is going to be created. [ 694.619612] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.619612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.619612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.619881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.621358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.635520] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f87689-4053-460b-b9e6-259755632006 in Status: IN_PROGRESS for 2s [ 694.645935] env[70032]: INFO networking_nsxv3.common.synchronization [None req-4518a296-c02a-437c-ba9b-8bd12a98682b None None] Enqueued Resource ID: a1832102-149e-481d-bfe2-a2929940afde with Priority: HIGHEST for action port [ 694.646158] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1832102-149e-481d-bfe2-a2929940afde with Priority: HIGHEST for action port [ 694.647261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1832102-149e-481d-bfe2-a2929940afde taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.647261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1832102-149e-481d-bfe2-a2929940afde" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.647261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1832102-149e-481d-bfe2-a2929940afde" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.648916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1832102-149e-481d-bfe2-a2929940afde" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.649015] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1832102-149e-481d-bfe2-a2929940afde',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.722379] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.722567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.722691] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.723022] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.723210] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.723360] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.723473] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.723682] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.723841] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.726462] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.726462] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.726462] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.726462] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.726462] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.726462] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.726728] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.755351] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.755351] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.755351] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.755351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.755351] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-760d508a-345a-4f79-838c-b52c422473a0 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.755351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.755351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.755351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.755351] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('760d508a-345a-4f79-838c-b52c422473a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.153753] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1832102-149e-481d-bfe2-a2929940afde [ 695.154224] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.154409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.154471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.154683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.154793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.154918] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1832102-149e-481d-bfe2-a2929940afde already deleted. [ 695.155075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1832102-149e-481d-bfe2-a2929940afde" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.259410] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.259808] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.259808] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.260214] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.260301] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.260378] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 760d508a-345a-4f79-838c-b52c422473a0 not found, creating... [ 695.260649] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.260831] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.260951] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.261237] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.261370] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.261672] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.261837] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.261961] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.264524] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.266087] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.266087] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 760d508a-345a-4f79-838c-b52c422473a0 is going to be created. [ 695.284105] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.284347] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.284539] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.284877] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.285184] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.285508] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.501702] env[70032]: INFO networking_nsxv3.common.synchronization [req-538a54fd-a9d1-409d-aee0-293f0cacadd9 req-382f3571-827d-4d90-b935-34b07009741e tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 695.501813] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 695.502117] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.502241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.502305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.502552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.502707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.502812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.502875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.504571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.504780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.504916] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.011736] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.011736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.011736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.011736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.011736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.011736] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.012182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.012182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.012182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.012270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.012376] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a already deleted. [ 696.012542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.155029] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.155029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.155199] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.155819] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.155819] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.155819] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.155987] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.156169] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.156311] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.156560] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.156633] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.156778] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.156846] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.156952] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.157069] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.157203] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.174105] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.174314] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.174432] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.174612] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.174997] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-ee8bf91a-1556-495c-8269-d35184c48903 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.175195] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.175317] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.175641] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.176089] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee8bf91a-1556-495c-8269-d35184c48903',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.273164] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: SUCCESS [ 696.273164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.273164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.273164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.273164] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.273164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.273164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.273164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.273164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.273670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.273670] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.398310] env[70032]: INFO networking_nsxv3.common.synchronization [req-7bb7ec50-5d57-4e6f-9f65-25ee489a875f req-e720e1fb-47ae-4686-a408-6b8f81427362 service nova] Enqueued Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_rules [ 696.398598] env[70032]: INFO networking_nsxv3.common.synchronization [req-7bb7ec50-5d57-4e6f-9f65-25ee489a875f req-e720e1fb-47ae-4686-a408-6b8f81427362 service nova] Enqueued Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_members [ 696.398791] env[70032]: INFO networking_nsxv3.common.synchronization [req-7bb7ec50-5d57-4e6f-9f65-25ee489a875f req-e720e1fb-47ae-4686-a408-6b8f81427362 service nova] Enqueued Resource ID: 760d508a-345a-4f79-838c-b52c422473a0 with Priority: HIGHEST for action port [ 696.399930] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_rules [ 696.399930] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_members [ 696.400063] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760d508a-345a-4f79-838c-b52c422473a0 with Priority: HIGHEST for action port [ 696.400401] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.400401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.400577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.400816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.400906] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.401998] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.401998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.401998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.402166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.402314] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.402410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.402474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.402619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.402707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.404120] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.404790] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-760d508a-345a-4f79-838c-b52c422473a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.404790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.404790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.404952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.405055] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('760d508a-345a-4f79-838c-b52c422473a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.648172] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f87689-4053-460b-b9e6-259755632006 in Status: SUCCESS [ 696.648461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.678550] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.678782] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.679349] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.679349] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.679349] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.679518] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port ee8bf91a-1556-495c-8269-d35184c48903 not found, creating... [ 696.680240] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.680364] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.680449] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.680996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.681312] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.681646] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.681801] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.682083] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.682617] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.682617] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.682798] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: ee8bf91a-1556-495c-8269-d35184c48903 is going to be created. [ 696.708638] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.708638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.708638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.708638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.708638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.708638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.775689] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.775947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.775947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.776262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.776413] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.776525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.776617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.776797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.776987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.776987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.777739] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.777739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.777739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.777739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.777739] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.777739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.777739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.778015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.778015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.778015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.778114] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.825532] env[70032]: INFO networking_nsxv3.common.synchronization [None req-56583442-ef9d-46cf-9847-c16af6274704 None None] Enqueued Resource ID: a903b516-3551-4f95-a296-dd214f6dc0bc with Priority: HIGHEST for action port [ 696.825532] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a903b516-3551-4f95-a296-dd214f6dc0bc with Priority: HIGHEST for action port [ 696.825532] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a903b516-3551-4f95-a296-dd214f6dc0bc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.825532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a903b516-3551-4f95-a296-dd214f6dc0bc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.825532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a903b516-3551-4f95-a296-dd214f6dc0bc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.826013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a903b516-3551-4f95-a296-dd214f6dc0bc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.826013] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a903b516-3551-4f95-a296-dd214f6dc0bc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.907667] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.907667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.907667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.909470] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 760d508a-345a-4f79-838c-b52c422473a0 with status ACTIVE [ 696.910051] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.911021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.911021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.911021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.911021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.911021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.911021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.911354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.911592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.911955] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.914256] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.914256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.914256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.914256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.914256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.914256] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 760d508a-345a-4f79-838c-b52c422473a0 is going to be updated. [ 696.945094] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.945094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.945252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.945881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.945881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.946881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-760d508a-345a-4f79-838c-b52c422473a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.280143] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5000c8de-0235-4e38-93be-83111bb42b93: rpc.has_security_group_logging(os_id): False [ 697.299358] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.299722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.299722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.300183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.300183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.300283] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.300343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.300518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.300582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.300873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.300873] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.300993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.301633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.302475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.302475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.302475] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.302475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.302672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.302712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.302921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.302921] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 is going to be created. [ 697.329040] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a903b516-3551-4f95-a296-dd214f6dc0bc [ 697.329224] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.329414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.329776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.330029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.330132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.330234] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a903b516-3551-4f95-a296-dd214f6dc0bc already deleted. [ 697.330315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a903b516-3551-4f95-a296-dd214f6dc0bc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.358206] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.358513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.358513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.358673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.358810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.370701] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: IN_PROGRESS for 2s [ 697.410793] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.832781] env[70032]: INFO networking_nsxv3.common.synchronization [None req-433b00e6-481b-47ae-8bdb-db5cb6e48b8f None None] Enqueued Resource ID: 51671f66-e340-481d-ad19-88fecc62bf39 with Priority: HIGHEST for action port [ 697.832781] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51671f66-e340-481d-ad19-88fecc62bf39 with Priority: HIGHEST for action port [ 697.832781] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-51671f66-e340-481d-ad19-88fecc62bf39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.832781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51671f66-e340-481d-ad19-88fecc62bf39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.832781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51671f66-e340-481d-ad19-88fecc62bf39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.833201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51671f66-e340-481d-ad19-88fecc62bf39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.833854] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51671f66-e340-481d-ad19-88fecc62bf39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.915591] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.915591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.915591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.915591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.915591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.915591] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 is going to be created. [ 697.938999] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.938999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.938999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.938999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.938999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.946303] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 in Status: UNINITIALIZED for 2s [ 698.058202] env[70032]: INFO networking_nsxv3.common.synchronization [req-e2edda4d-d191-402d-974f-be43b3084a4e req-8414e84e-ac6b-49ae-97a0-0bd7b2b2eab5 tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 698.058293] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 698.059241] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.059361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.059361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.059606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.060199] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.060199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.060199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.060199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.060370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.060370] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.241017] env[70032]: INFO networking_nsxv3.common.synchronization [req-538a54fd-a9d1-409d-aee0-293f0cacadd9 req-69643a8b-30d7-4070-988f-90a68ded6b2b service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 698.241282] env[70032]: INFO networking_nsxv3.common.synchronization [req-538a54fd-a9d1-409d-aee0-293f0cacadd9 req-69643a8b-30d7-4070-988f-90a68ded6b2b service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 698.241331] env[70032]: INFO networking_nsxv3.common.synchronization [req-538a54fd-a9d1-409d-aee0-293f0cacadd9 req-69643a8b-30d7-4070-988f-90a68ded6b2b service nova] Enqueued Resource ID: ee8bf91a-1556-495c-8269-d35184c48903 with Priority: HIGHEST for action port [ 698.243898] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 698.244080] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 698.244206] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8bf91a-1556-495c-8269-d35184c48903 with Priority: HIGHEST for action port [ 698.247261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.247497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.247497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.247813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.247937] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.248729] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.248908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.248986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.249165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.249916] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.250236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.250296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.250438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.250533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.250627] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.252427] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee8bf91a-1556-495c-8269-d35184c48903 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.252427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.252427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.252604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.252604] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee8bf91a-1556-495c-8269-d35184c48903',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.338521] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51671f66-e340-481d-ad19-88fecc62bf39 [ 698.340211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.340211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.340211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.340211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.340211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.340211] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51671f66-e340-481d-ad19-88fecc62bf39 already deleted. [ 698.340211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51671f66-e340-481d-ad19-88fecc62bf39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.562407] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.562952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.562952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.562952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.562952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.563142] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.563247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.563329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.563490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.563564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.563658] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 already deleted. [ 698.563762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.754700] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.756099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.756099] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.757273] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee8bf91a-1556-495c-8269-d35184c48903 with status ACTIVE [ 698.757273] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.757273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.757473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.757633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.757959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.758158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.758312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.758420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.758610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.758969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.759280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.759390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.759462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.759643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.759740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.759827] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee8bf91a-1556-495c-8269-d35184c48903 is going to be updated. [ 698.810185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.810416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.810517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.810839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.811161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.811484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee8bf91a-1556-495c-8269-d35184c48903" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.921204] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.921408] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.921738] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.921907] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.922713] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.923230] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.923361] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.924294] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.924294] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.924680] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.925028] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.925580] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.925580] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.926136] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.926694] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.926694] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.949458] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.949458] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.949738] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.949906] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.950281] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-67cd456a-4294-4ce0-aaf7-742237dd2a2c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.950585] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.950674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.951304] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.951304] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67cd456a-4294-4ce0-aaf7-742237dd2a2c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.262340] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.386834] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: SUCCESS [ 699.386834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.455510] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.455510] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.455510] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.455775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.456294] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.456294] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 67cd456a-4294-4ce0-aaf7-742237dd2a2c not found, creating... [ 699.456417] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.456565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.457132] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.457132] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.457132] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.457353] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.457507] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.457624] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.459760] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.459760] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.459760] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 67cd456a-4294-4ce0-aaf7-742237dd2a2c is going to be created. [ 699.485189] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.485548] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.485912] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.487380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.487380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.487380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.765958] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.766177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.766245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.766472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.766565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.766662] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be created. [ 699.794151] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.794293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.794373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.794589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.794780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.804826] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: UNINITIALIZED for 2s [ 699.959261] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 in Status: SUCCESS [ 699.959510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.959703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.959940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.960177] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.960316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.960400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.960563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.961741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.961741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.961741] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.094860] env[70032]: INFO networking_nsxv3.common.synchronization [None req-bd450590-3671-4555-9988-70d22f807975 None None] Enqueued Resource ID: 394de03f-d928-4fcf-8e23-abb4d8960bea with Priority: HIGHEST for action port [ 700.095420] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394de03f-d928-4fcf-8e23-abb4d8960bea with Priority: HIGHEST for action port [ 700.095717] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-394de03f-d928-4fcf-8e23-abb4d8960bea taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.095846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-394de03f-d928-4fcf-8e23-abb4d8960bea" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.095906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-394de03f-d928-4fcf-8e23-abb4d8960bea" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.098820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-394de03f-d928-4fcf-8e23-abb4d8960bea" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.099180] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('394de03f-d928-4fcf-8e23-abb4d8960bea',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.466590] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.466922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.466922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.467182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.467261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.467329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.467407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.467528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.467610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.467742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.467836] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.468055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.468055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.468197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.468281] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.468360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.468420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.468534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.468635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.468703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.469050] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.517026] env[70032]: INFO networking_nsxv3.common.synchronization [req-cc955317-c570-4009-b924-b74aa307925a req-39587381-f800-41a3-8b4e-7238473c2ef0 tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 700.517026] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 700.517026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.517026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.517026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.517026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.517607] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.517873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.518156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.518509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.518715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.518966] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.604194] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 394de03f-d928-4fcf-8e23-abb4d8960bea [ 700.604836] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.606181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.606181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.606181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.606181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.607057] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:394de03f-d928-4fcf-8e23-abb4d8960bea already deleted. [ 700.607057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-394de03f-d928-4fcf-8e23-abb4d8960bea" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.754550] env[70032]: INFO networking_nsxv3.common.synchronization [req-e2edda4d-d191-402d-974f-be43b3084a4e req-9639a10c-7129-4a63-b346-935e09f16a8b service nova] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_rules [ 700.754733] env[70032]: INFO networking_nsxv3.common.synchronization [req-e2edda4d-d191-402d-974f-be43b3084a4e req-9639a10c-7129-4a63-b346-935e09f16a8b service nova] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 700.754867] env[70032]: INFO networking_nsxv3.common.synchronization [req-e2edda4d-d191-402d-974f-be43b3084a4e req-9639a10c-7129-4a63-b346-935e09f16a8b service nova] Enqueued Resource ID: 67cd456a-4294-4ce0-aaf7-742237dd2a2c with Priority: HIGHEST for action port [ 700.755459] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_rules [ 700.757020] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 700.757020] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67cd456a-4294-4ce0-aaf7-742237dd2a2c with Priority: HIGHEST for action port [ 700.757020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.757992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.758076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.758337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.758462] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.760059] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.760166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.760365] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-67cd456a-4294-4ce0-aaf7-742237dd2a2c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.760475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.760547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.760762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.760826] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67cd456a-4294-4ce0-aaf7-742237dd2a2c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.976815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4: rpc.has_security_group_logging(os_id): False [ 700.995412] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.995541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.995589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.995844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.995929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.996536] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.996658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.997025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.997290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.997338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.997895] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.998033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.998112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.998737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.998737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.998737] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.998737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.998737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.999021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.999021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.999021] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 is going to be created. [ 701.022545] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.055067] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.055067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.055067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.055067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.055067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.065526] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 in Status: IN_PROGRESS for 2s [ 701.260539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.260683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.264907] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67cd456a-4294-4ce0-aaf7-742237dd2a2c with status ACTIVE [ 701.264907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.264907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.264907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.264907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.264907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.264907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.264907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.264907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.265357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.265357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.265357] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.265357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.265550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.265550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.265614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.265701] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67cd456a-4294-4ce0-aaf7-742237dd2a2c is going to be updated. [ 701.289457] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.289457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.289457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.289457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.289457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.289941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67cd456a-4294-4ce0-aaf7-742237dd2a2c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.460640] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b2511854-73e5-4a59-b0d5-be95b76881b3 None None] Enqueued Resource ID: 9ac6085c-f4e1-4852-8c89-a9d72fdff6a6 with Priority: HIGHEST for action port [ 701.460640] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac6085c-f4e1-4852-8c89-a9d72fdff6a6 with Priority: HIGHEST for action port [ 701.460640] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ac6085c-f4e1-4852-8c89-a9d72fdff6a6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.461483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ac6085c-f4e1-4852-8c89-a9d72fdff6a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.463124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ac6085c-f4e1-4852-8c89-a9d72fdff6a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.463124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ac6085c-f4e1-4852-8c89-a9d72fdff6a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.463124] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac6085c-f4e1-4852-8c89-a9d72fdff6a6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.525457] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.573380] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.573607] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.573741] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.574084] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.574393] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.574559] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.574690] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.574972] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.575237] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.575452] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.575584] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.575695] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.575801] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.576627] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.576627] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.576627] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.597568] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.597823] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.598055] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.598367] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.598680] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-61d6cc24-d238-440d-923f-cd1fd6c282dd taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.598972] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.599195] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.599634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.599882] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61d6cc24-d238-440d-923f-cd1fd6c282dd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.770291] env[70032]: INFO networking_nsxv3.common.synchronization [None req-0f5f5d2a-8ffb-453d-a88c-46b6f95ee895 None None] Enqueued Resource ID: bd5227a7-2cd0-4c5d-8a0b-24b629166411 with Priority: HIGHEST for action port [ 701.770291] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd5227a7-2cd0-4c5d-8a0b-24b629166411 with Priority: HIGHEST for action port [ 701.770291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd5227a7-2cd0-4c5d-8a0b-24b629166411 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.770291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd5227a7-2cd0-4c5d-8a0b-24b629166411" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.770291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd5227a7-2cd0-4c5d-8a0b-24b629166411" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.770291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd5227a7-2cd0-4c5d-8a0b-24b629166411" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.770291] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5227a7-2cd0-4c5d-8a0b-24b629166411',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.815265] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 701.815818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.817209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.817438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.817601] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.817817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.817905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.818173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.818294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.818421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.818530] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.965552] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ac6085c-f4e1-4852-8c89-a9d72fdff6a6 [ 701.966817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.966817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.966817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.966817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.966817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.966817] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ac6085c-f4e1-4852-8c89-a9d72fdff6a6 already deleted. [ 701.966817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ac6085c-f4e1-4852-8c89-a9d72fdff6a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.028077] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.031396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.031396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.031396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.031396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.031396] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be created. [ 702.054229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.054374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.054431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.056172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.056172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.063994] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: UNINITIALIZED for 2s [ 702.105325] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.105553] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.105680] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.105987] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.106203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.106326] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 61d6cc24-d238-440d-923f-cd1fd6c282dd not found, creating... [ 702.106585] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.106743] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.106902] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.107248] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.107248] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.107500] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.107650] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.107770] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.107979] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.108996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.108996] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 61d6cc24-d238-440d-923f-cd1fd6c282dd is going to be created. [ 702.127936] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.128215] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.128290] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.128585] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.128811] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.129045] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.274895] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd5227a7-2cd0-4c5d-8a0b-24b629166411 [ 702.274895] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.274895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.274895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.274895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.274895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.274895] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd5227a7-2cd0-4c5d-8a0b-24b629166411 already deleted. [ 702.274895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd5227a7-2cd0-4c5d-8a0b-24b629166411" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.322675] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.322675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.322675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.322675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.322675] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.322675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.322675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.323327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.323327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.323327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.323818] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.323818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.323818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.323818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.324805] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.324805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.324805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.324805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.324805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.324805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.328482] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.830476] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1d61d13-44e5-4c83-936b-8a6c378d760a: rpc.has_security_group_logging(os_id): False [ 702.853238] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853238] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853238] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853827] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853827] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be created. [ 702.913575] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.913751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.913875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.914488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.914773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.926515] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 703.061317] env[70032]: INFO networking_nsxv3.common.synchronization [req-0dd7d556-600d-41e3-bcb7-3aafa210a43d req-4c133fda-cf8b-43b9-abb4-da7139821dfa tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_members [ 703.061889] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_members [ 703.062893] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.062893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.062893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.064116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.064116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.064951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.065064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.065255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.065351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.065609] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.079699] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 in Status: SUCCESS [ 703.079922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.568554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.568763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.568838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.569352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.569352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.569645] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.569789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.569881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.570084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.570208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.570408] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 already deleted. [ 703.570408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.727794] env[70032]: INFO networking_nsxv3.common.synchronization [None req-849e8ef4-8740-4774-a01d-464eaace6efe None None] Enqueued Resource ID: 89f561f7-e53a-4099-a9a9-22419eadc699 with Priority: HIGHEST for action port [ 703.731545] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89f561f7-e53a-4099-a9a9-22419eadc699 with Priority: HIGHEST for action port [ 703.731855] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-89f561f7-e53a-4099-a9a9-22419eadc699 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.731983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89f561f7-e53a-4099-a9a9-22419eadc699" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.732061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89f561f7-e53a-4099-a9a9-22419eadc699" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.732347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89f561f7-e53a-4099-a9a9-22419eadc699" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.732451] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89f561f7-e53a-4099-a9a9-22419eadc699',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.926698] env[70032]: INFO networking_nsxv3.common.synchronization [req-cc955317-c570-4009-b924-b74aa307925a req-fcd1b644-035c-4861-b3dd-43d7ad31fb4c service nova] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_rules [ 703.926998] env[70032]: INFO networking_nsxv3.common.synchronization [req-cc955317-c570-4009-b924-b74aa307925a req-fcd1b644-035c-4861-b3dd-43d7ad31fb4c service nova] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 703.926998] env[70032]: INFO networking_nsxv3.common.synchronization [req-cc955317-c570-4009-b924-b74aa307925a req-fcd1b644-035c-4861-b3dd-43d7ad31fb4c service nova] Enqueued Resource ID: 61d6cc24-d238-440d-923f-cd1fd6c282dd with Priority: HIGHEST for action port [ 703.927355] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_rules [ 703.927445] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 703.927492] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d6cc24-d238-440d-923f-cd1fd6c282dd with Priority: HIGHEST for action port [ 703.928340] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.928340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.928470] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.928470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.928638] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-61d6cc24-d238-440d-923f-cd1fd6c282dd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.928735] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.928794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.929013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.929346] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61d6cc24-d238-440d-923f-cd1fd6c282dd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.074932] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 704.074932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.074932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.077030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.077030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.077030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.077030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.077030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.077030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.077030] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.236586] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89f561f7-e53a-4099-a9a9-22419eadc699 [ 704.236912] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.237106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.237205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.237472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.237578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.237736] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89f561f7-e53a-4099-a9a9-22419eadc699 already deleted. [ 704.237783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89f561f7-e53a-4099-a9a9-22419eadc699" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.432011] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61d6cc24-d238-440d-923f-cd1fd6c282dd with status ACTIVE [ 704.432011] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.432161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.432197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.432841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.432841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.432841] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.432841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.432841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.433170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.433170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.433890] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.433890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.433890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.433890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.433890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.433890] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61d6cc24-d238-440d-923f-cd1fd6c282dd is going to be updated. [ 704.440566] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.440658] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.440989] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.444025] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.444025] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.444025] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.444025] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.444025] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.444025] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.444025] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.444025] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.444025] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.444025] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.444025] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.444606] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.444606] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.477476] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.477476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.477476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.477476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.477723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.477773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61d6cc24-d238-440d-923f-cd1fd6c282dd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.480510] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.480693] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.480838] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.481013] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.481313] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.481479] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.481600] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.481922] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.482085] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6cdacf-e1b0-47b1-9fd8-0660c71fe019',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.579274] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.940210] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 704.940531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.986663] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.986928] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.987124] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.987450] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.987666] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.987823] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 not found, creating... [ 704.988146] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.988459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.988459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.988543] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.988821] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.989053] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.989153] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.989292] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.989806] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.989806] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.989806] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 is going to be created. [ 705.010611] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.010829] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.010966] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.011262] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.012033] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.012033] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.081765] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.584283] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.584534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.584534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.584722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.584811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.584892] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be updated. [ 705.598969] env[70032]: INFO networking_nsxv3.common.synchronization [None req-77109566-3e63-4374-b07d-a2a9a032e795 None None] Enqueued Resource ID: 7739859a-d59a-4c4a-a7e3-106de2d58ff7 with Priority: HIGHEST for action port [ 705.599253] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7739859a-d59a-4c4a-a7e3-106de2d58ff7 with Priority: HIGHEST for action port [ 705.600218] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7739859a-d59a-4c4a-a7e3-106de2d58ff7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.600218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7739859a-d59a-4c4a-a7e3-106de2d58ff7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.600218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7739859a-d59a-4c4a-a7e3-106de2d58ff7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.601139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7739859a-d59a-4c4a-a7e3-106de2d58ff7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.601139] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7739859a-d59a-4c4a-a7e3-106de2d58ff7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.627592] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.627856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.627856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.627990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.628181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.638579] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: IN_PROGRESS for 2s [ 705.776532] env[70032]: INFO networking_nsxv3.common.synchronization [req-69f55383-78a9-47f8-8fdb-3ce65e0505b8 req-f422cc5b-b67c-4d47-b5f2-3fa9255c287b tempest-ServerAddressesNegativeTestJSON-206255264 tempest-ServerAddressesNegativeTestJSON-206255264-project-member] Enqueued Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_members [ 705.776532] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_members [ 705.776901] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54f2196-33e3-453f-a911-75188cea4a01 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.777061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.777130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.777389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.777549] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.777644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.777707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.777891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.777983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.778091] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.103511] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7739859a-d59a-4c4a-a7e3-106de2d58ff7 [ 706.103511] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.103511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.103511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.103511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.103511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.103511] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7739859a-d59a-4c4a-a7e3-106de2d58ff7 already deleted. [ 706.103511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7739859a-d59a-4c4a-a7e3-106de2d58ff7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.151350] env[70032]: INFO networking_nsxv3.common.synchronization [None req-fdaf18e3-20f7-4a50-aea7-6bf532bea376 None None] Enqueued Resource ID: ed6e37c9-a330-43a4-b1c0-a5235cc98ccc with Priority: HIGHEST for action port [ 706.151700] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed6e37c9-a330-43a4-b1c0-a5235cc98ccc with Priority: HIGHEST for action port [ 706.152207] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed6e37c9-a330-43a4-b1c0-a5235cc98ccc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.152337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed6e37c9-a330-43a4-b1c0-a5235cc98ccc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.152407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed6e37c9-a330-43a4-b1c0-a5235cc98ccc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.152659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed6e37c9-a330-43a4-b1c0-a5235cc98ccc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.152747] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed6e37c9-a330-43a4-b1c0-a5235cc98ccc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.281906] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.281991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.286177] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.286177] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54f2196-33e3-453f-a911-75188cea4a01 already deleted. [ 706.286177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.658149] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed6e37c9-a330-43a4-b1c0-a5235cc98ccc [ 706.658149] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.658149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.658149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.658149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.658149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.658149] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed6e37c9-a330-43a4-b1c0-a5235cc98ccc already deleted. [ 706.658149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed6e37c9-a330-43a4-b1c0-a5235cc98ccc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.870678] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8abfe919-2dab-4521-b5a6-1c16e18fd5f1 None None] Enqueued Resource ID: 72270aaa-6e8d-4b98-ba70-8ce362696736 with Priority: HIGHEST for action port [ 706.871509] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72270aaa-6e8d-4b98-ba70-8ce362696736 with Priority: HIGHEST for action port [ 706.871970] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-72270aaa-6e8d-4b98-ba70-8ce362696736 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.876414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72270aaa-6e8d-4b98-ba70-8ce362696736" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.876414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72270aaa-6e8d-4b98-ba70-8ce362696736" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.876414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72270aaa-6e8d-4b98-ba70-8ce362696736" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.876414] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72270aaa-6e8d-4b98-ba70-8ce362696736',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.378448] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72270aaa-6e8d-4b98-ba70-8ce362696736 [ 707.380387] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.382300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.382300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.382300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.382300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.382300] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72270aaa-6e8d-4b98-ba70-8ce362696736 already deleted. [ 707.382300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72270aaa-6e8d-4b98-ba70-8ce362696736" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.566025] env[70032]: INFO networking_nsxv3.common.synchronization [req-0dd7d556-600d-41e3-bcb7-3aafa210a43d req-728e3101-9b8a-4411-b79b-399f71a3de23 service nova] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_rules [ 707.566025] env[70032]: INFO networking_nsxv3.common.synchronization [req-0dd7d556-600d-41e3-bcb7-3aafa210a43d req-728e3101-9b8a-4411-b79b-399f71a3de23 service nova] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_members [ 707.566025] env[70032]: INFO networking_nsxv3.common.synchronization [req-0dd7d556-600d-41e3-bcb7-3aafa210a43d req-728e3101-9b8a-4411-b79b-399f71a3de23 service nova] Enqueued Resource ID: fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 with Priority: HIGHEST for action port [ 707.566025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_rules [ 707.566025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_members [ 707.566025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 with Priority: HIGHEST for action port [ 707.566025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.566025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.566025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.566025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.566025] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.566622] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.566622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.566622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.566823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.567526] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.567526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.567526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.567526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.567526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.567526] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.568420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.568493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.568758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.568758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.574318] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6cdacf-e1b0-47b1-9fd8-0660c71fe019',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.649374] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 707.649790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.650286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.652874] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.652874] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.652874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.653280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.653280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.653280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.653503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.653586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.653674] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.766916] env[70032]: INFO networking_nsxv3.common.synchronization [None req-a11d27fe-aaf9-43b1-bc8c-ff760f5be009 None None] Enqueued Resource ID: 744ae74c-5293-4fea-ae1e-b1249c0fdbc9 with Priority: HIGHEST for action port [ 707.767187] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744ae74c-5293-4fea-ae1e-b1249c0fdbc9 with Priority: HIGHEST for action port [ 707.767744] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-744ae74c-5293-4fea-ae1e-b1249c0fdbc9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.767866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-744ae74c-5293-4fea-ae1e-b1249c0fdbc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.767935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-744ae74c-5293-4fea-ae1e-b1249c0fdbc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.768197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-744ae74c-5293-4fea-ae1e-b1249c0fdbc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.768277] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('744ae74c-5293-4fea-ae1e-b1249c0fdbc9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.974731] env[70032]: INFO networking_nsxv3.common.synchronization [None req-fee560c5-2337-4e96-8028-e8eea7fc0fa2 None None] Enqueued Resource ID: 67ea66db-653e-4a3e-bfcb-b39690bb4ec3 with Priority: HIGHEST for action port [ 707.974731] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67ea66db-653e-4a3e-bfcb-b39690bb4ec3 with Priority: HIGHEST for action port [ 707.974731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-67ea66db-653e-4a3e-bfcb-b39690bb4ec3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.974731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67ea66db-653e-4a3e-bfcb-b39690bb4ec3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.974731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67ea66db-653e-4a3e-bfcb-b39690bb4ec3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.975318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67ea66db-653e-4a3e-bfcb-b39690bb4ec3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.975318] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ea66db-653e-4a3e-bfcb-b39690bb4ec3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.078025] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.078025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.078025] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 with status ACTIVE [ 708.078025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.078025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.078025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.079070] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.079070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.079070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.080859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.081087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.084408] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb6cdacf-e1b0-47b1-9fd8-0660c71fe019 is going to be updated. [ 708.105148] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.105317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.105395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.105567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.106573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.106844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6cdacf-e1b0-47b1-9fd8-0660c71fe019" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.118747] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.119301] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-463" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.119562] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-463" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.119899] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-463" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.120181] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.120705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.120705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.120705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.120850] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.121108] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.121250] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.121360] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.121473] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.121586] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.121694] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.121829] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.140180] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.140596] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 708.140805] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.140944] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-463" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.141414] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-fc844d8d-d157-414f-b1f7-4c70ed6231b9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.141632] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.141811] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.142293] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.142437] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc844d8d-d157-414f-b1f7-4c70ed6231b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.156890] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.156890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.156890] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.271852] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 744ae74c-5293-4fea-ae1e-b1249c0fdbc9 [ 708.271852] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.271852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.272164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.272164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.272276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.272327] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:744ae74c-5293-4fea-ae1e-b1249c0fdbc9 already deleted. [ 708.272981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-744ae74c-5293-4fea-ae1e-b1249c0fdbc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.479589] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67ea66db-653e-4a3e-bfcb-b39690bb4ec3 [ 708.480454] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.480770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.480939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.481386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.481591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.481768] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67ea66db-653e-4a3e-bfcb-b39690bb4ec3 already deleted. [ 708.482314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67ea66db-653e-4a3e-bfcb-b39690bb4ec3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.584480] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.645274] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.645736] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.646044] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.646318] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.646582] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.646825] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port fc844d8d-d157-414f-b1f7-4c70ed6231b9 not found, creating... [ 708.648172] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.648172] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.648172] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.648172] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.648172] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.648780] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.650674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.650674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.650674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.650796] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.652203] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: fc844d8d-d157-414f-b1f7-4c70ed6231b9 is going to be created. [ 708.660788] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.671465] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.672294] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.672294] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.672499] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.673126] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.673126] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.680168] env[70032]: INFO networking_nsxv3.common.synchronization [req-1f6b63d2-5845-46ee-b6ed-fc4609bff982 req-1bbc7de2-802e-4d5d-b197-22d7981b8b25 tempest-ServersWithSpecificFlavorTestJSON-1841008358 tempest-ServersWithSpecificFlavorTestJSON-1841008358-project-member] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 708.680504] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 708.680855] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.681047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.681183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.682655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.683254] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.683721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.684579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.684957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.684957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.685194] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.897318] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d7d8fba2-752a-40c6-a75b-7c01799885b1 None None] Enqueued Resource ID: 5ca3cdac-1265-40eb-bbcb-15eabe7f3c65 with Priority: HIGHEST for action port [ 708.897318] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ca3cdac-1265-40eb-bbcb-15eabe7f3c65 with Priority: HIGHEST for action port [ 708.898599] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ca3cdac-1265-40eb-bbcb-15eabe7f3c65 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.898832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ca3cdac-1265-40eb-bbcb-15eabe7f3c65" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.899108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ca3cdac-1265-40eb-bbcb-15eabe7f3c65" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.899675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ca3cdac-1265-40eb-bbcb-15eabe7f3c65" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.899675] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ca3cdac-1265-40eb-bbcb-15eabe7f3c65',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.981129] env[70032]: INFO networking_nsxv3.common.synchronization [req-0a265d2d-eaa0-4a2f-a58e-19a827fdbb84 req-4dc75526-ad6d-40c7-9070-2e6699351dbe tempest-DeleteServersAdminTestJSON-394633662 tempest-DeleteServersAdminTestJSON-394633662-project-admin] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 708.981129] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 708.981129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.981129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.982083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.982302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.982462] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.982756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.982829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.982995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.983101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.983199] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.089586] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.090649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.090889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.091216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.091407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.091596] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 is going to be created. [ 709.115540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.115540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.115540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.115540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.115540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.124837] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: UNINITIALIZED for 2s [ 709.165150] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.165150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.165630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.165760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.165922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.167158] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be updated. [ 709.188924] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.189243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.189243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.189462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.189585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.189785] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.189896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.193110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.193377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.193472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.193594] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef already deleted. [ 709.193671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.199506] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.199705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.199705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.199893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.200065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.208586] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: IN_PROGRESS for 2s [ 709.403124] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ca3cdac-1265-40eb-bbcb-15eabe7f3c65 [ 709.403465] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.403530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.403580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.404127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.404127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.404127] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ca3cdac-1265-40eb-bbcb-15eabe7f3c65 already deleted. [ 709.404127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ca3cdac-1265-40eb-bbcb-15eabe7f3c65" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.488089] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.488089] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.488089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.488089] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 is going to be updated. [ 709.530493] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.530493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.530493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.530493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.530493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.539130] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: IN_PROGRESS for 2s [ 709.592026] env[70032]: INFO networking_nsxv3.common.synchronization [None req-12db08de-5efc-4eb1-a167-a973a6ecf89e tempest-ServersTestFqdnHostnames-1197439368 tempest-ServersTestFqdnHostnames-1197439368-project-member] Enqueued Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_rules [ 709.592026] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_rules [ 709.592026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b20098c3-4944-4612-af2a-f2d01874388d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.592026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.592026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.592026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.592026] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.691772] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8b15b88d-6d61-4d86-a651-5d49fb6eed1f tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 709.692295] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 709.692596] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.693142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.693142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.697172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.697287] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.111091] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.111335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.111335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.112036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.112036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.112036] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b20098c3-4944-4612-af2a-f2d01874388d already deleted. [ 710.112036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.221303] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.221484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.221549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.222075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.222075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.222075] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa already deleted. [ 710.222261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.354356] env[70032]: INFO networking_nsxv3.common.synchronization [None req-7b5d47e5-6c86-4cc4-8f8e-7f98f8bc762c tempest-ServersTestFqdnHostnames-1197439368 tempest-ServersTestFqdnHostnames-1197439368-project-member] Enqueued Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_rules [ 710.357501] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_rules [ 710.359503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b20098c3-4944-4612-af2a-f2d01874388d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.359503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.359503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.359503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.359503] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.588879] env[70032]: INFO networking_nsxv3.common.synchronization [None req-62613c3f-7f75-4f49-91a2-c3ba5259e7bc tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 710.589430] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 710.589731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.589857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.589950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.590175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.590256] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.807297] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.807297] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.807297] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.807297] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.807297] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.807297] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.808364] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.808364] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.808364] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.808711] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.808711] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.808818] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.808919] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.809043] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.809217] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.809276] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.832355] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.832499] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 710.832899] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.833155] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.833485] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-4b82a4bd-dcd2-449e-acf8-8a338709dc75 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.833932] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.833932] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.834393] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.834545] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b82a4bd-dcd2-449e-acf8-8a338709dc75',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.886068] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.886068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.886068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.886068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.886068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.886068] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b20098c3-4944-4612-af2a-f2d01874388d already deleted. [ 710.886068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.949134] env[70032]: INFO networking_nsxv3.common.synchronization [None req-6a3e86fc-ebe6-4047-aaca-543198c108cf None None] Enqueued Resource ID: cf46dab4-26e9-443e-842b-609608fcb5af with Priority: HIGHEST for action port [ 710.949834] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf46dab4-26e9-443e-842b-609608fcb5af with Priority: HIGHEST for action port [ 710.950439] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf46dab4-26e9-443e-842b-609608fcb5af taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.950581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf46dab4-26e9-443e-842b-609608fcb5af" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.950654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf46dab4-26e9-443e-842b-609608fcb5af" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.951098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf46dab4-26e9-443e-842b-609608fcb5af" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.951200] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf46dab4-26e9-443e-842b-609608fcb5af',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.112935] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.112935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.112935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.112935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.112935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.112935] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa already deleted. [ 711.112935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.134387] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: UNINITIALIZED for 4s [ 711.156288] env[70032]: INFO networking_nsxv3.common.synchronization [req-69f55383-78a9-47f8-8fdb-3ce65e0505b8 req-fca2c515-d9cb-4fbb-b54c-50c242215d66 service nova] Enqueued Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_rules [ 711.157372] env[70032]: INFO networking_nsxv3.common.synchronization [req-69f55383-78a9-47f8-8fdb-3ce65e0505b8 req-fca2c515-d9cb-4fbb-b54c-50c242215d66 service nova] Enqueued Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_members [ 711.157372] env[70032]: INFO networking_nsxv3.common.synchronization [req-69f55383-78a9-47f8-8fdb-3ce65e0505b8 req-fca2c515-d9cb-4fbb-b54c-50c242215d66 service nova] Enqueued Resource ID: fc844d8d-d157-414f-b1f7-4c70ed6231b9 with Priority: HIGHEST for action port [ 711.157372] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_rules [ 711.157499] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_members [ 711.157591] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc844d8d-d157-414f-b1f7-4c70ed6231b9 with Priority: HIGHEST for action port [ 711.157989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c54f2196-33e3-453f-a911-75188cea4a01 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.158872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.159017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.159304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.159393] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.160302] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54f2196-33e3-453f-a911-75188cea4a01 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.160792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.160792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.160792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.160792] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.161168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.161712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.161712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.161712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.162289] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.162640] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc844d8d-d157-414f-b1f7-4c70ed6231b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.163353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.163353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.163353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.163353] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc844d8d-d157-414f-b1f7-4c70ed6231b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.217887] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 711.218136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.218302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.218518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.218714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.218841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.218911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.219068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.219154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.219480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.219612] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.219714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.219774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.219924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.220205] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.220205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.220205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.220384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.220488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.220574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.220726] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.338762] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.338992] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.339142] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.339423] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.339577] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.339734] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 4b82a4bd-dcd2-449e-acf8-8a338709dc75 not found, creating... [ 711.339995] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.340380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.340380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.340514] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.340639] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.340919] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.341118] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.341238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.341445] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.341585] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.341879] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 4b82a4bd-dcd2-449e-acf8-8a338709dc75 is going to be created. [ 711.359983] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.360238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.360367] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.360625] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.360849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.361086] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.453392] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf46dab4-26e9-443e-842b-609608fcb5af [ 711.453658] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.453802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.453904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.454159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.454258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.454366] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf46dab4-26e9-443e-842b-609608fcb5af already deleted. [ 711.454451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf46dab4-26e9-443e-842b-609608fcb5af" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.549740] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: SUCCESS [ 711.552184] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 deletion is rescheduled due to dependency. [ 711.552184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.667284] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.667619] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54f2196-33e3-453f-a911-75188cea4a01 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.667695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.667938] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc844d8d-d157-414f-b1f7-4c70ed6231b9 with status ACTIVE [ 711.668138] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.668138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.668138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.668442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.668442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.669226] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.669226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.669226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.669226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.670446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.670446] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.670446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.670446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.670771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.670849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.670950] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc844d8d-d157-414f-b1f7-4c70ed6231b9 is going to be updated. [ 711.695160] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.695327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.695515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.695597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.695726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.695883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc844d8d-d157-414f-b1f7-4c70ed6231b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.724550] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2546188-fcd4-4401-b075-87ffd0e4a9a9: rpc.has_security_group_logging(os_id): False [ 711.749608] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.749838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.749920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.750166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.750270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.750469] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.750569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.750626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.751160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.751160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.751160] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.751160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.751440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.751440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.753657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.753657] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.753657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.753657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.753657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.753657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.753657] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be created. [ 711.846038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.846311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.846311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.847053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.847053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.866010] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: IN_PROGRESS for 2s [ 711.903431] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c8229669-52e4-46d4-ab7d-fbabdc00a030 None None] Enqueued Resource ID: 71846183-0219-462a-a68e-7e908a6cc58d with Priority: HIGHEST for action port [ 711.904833] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71846183-0219-462a-a68e-7e908a6cc58d with Priority: HIGHEST for action port [ 711.904833] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-71846183-0219-462a-a68e-7e908a6cc58d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.904833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71846183-0219-462a-a68e-7e908a6cc58d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.904833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71846183-0219-462a-a68e-7e908a6cc58d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.905271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71846183-0219-462a-a68e-7e908a6cc58d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.905271] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71846183-0219-462a-a68e-7e908a6cc58d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.152361] env[70032]: INFO networking_nsxv3.common.synchronization [req-900b440b-de98-4e37-bd39-5ab4463fae7c req-d0e59d2e-05d4-4a18-891b-07d7fe38416d tempest-FloatingIPsAssociationTestJSON-445852628 tempest-FloatingIPsAssociationTestJSON-445852628-project-member] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 712.154057] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 712.155134] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.155134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.155134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.155134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.155602] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.155602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.155602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.155602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.155602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.155784] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.176635] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.412529] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71846183-0219-462a-a68e-7e908a6cc58d [ 712.412529] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.412529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.412724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.412845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.412965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.413084] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71846183-0219-462a-a68e-7e908a6cc58d already deleted. [ 712.413172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71846183-0219-462a-a68e-7e908a6cc58d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.659851] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.659851] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.659851] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 already deleted. [ 712.659851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.677577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.677577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.677577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.677577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.677577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.678046] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54f2196-33e3-453f-a911-75188cea4a01 is going to be created. [ 712.700839] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.700839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.700839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.700839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.700839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.710440] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54f2196-33e3-453f-a911-75188cea4a01 in Status: UNINITIALIZED for 2s [ 712.977605] env[70032]: INFO networking_nsxv3.common.synchronization [None req-36cf35a1-62c8-4c0d-98e6-7b70f987744d None None] Enqueued Resource ID: aec392b7-965d-41cc-8638-44cc91b20d79 with Priority: HIGHEST for action port [ 712.977705] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec392b7-965d-41cc-8638-44cc91b20d79 with Priority: HIGHEST for action port [ 712.978291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-aec392b7-965d-41cc-8638-44cc91b20d79 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.978491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aec392b7-965d-41cc-8638-44cc91b20d79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.978491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aec392b7-965d-41cc-8638-44cc91b20d79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.978729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aec392b7-965d-41cc-8638-44cc91b20d79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.978921] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aec392b7-965d-41cc-8638-44cc91b20d79',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.144952] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: SUCCESS [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.144952] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.144952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.144952] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.206605] env[70032]: INFO networking_nsxv3.common.synchronization [req-ff1568f0-fab8-4a72-9b5f-04c417af7213 req-5365b009-8ea1-4663-b90b-d008bfc0f6bc tempest-ServerExternalEventsTest-1522446835 tempest-ServerExternalEventsTest-1522446835-project-member] Enqueued Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_members [ 713.206605] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGHEST for action security_group_members [ 713.206605] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.206825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.206825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.207031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.207202] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.207407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.207407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.207681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.207681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.207782] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.259259] env[70032]: INFO networking_nsxv3.common.synchronization [req-1f6b63d2-5845-46ee-b6ed-fc4609bff982 req-514a1b84-94b9-49e2-bc95-237f30b92b5c service nova] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 713.259425] env[70032]: INFO networking_nsxv3.common.synchronization [req-1f6b63d2-5845-46ee-b6ed-fc4609bff982 req-514a1b84-94b9-49e2-bc95-237f30b92b5c service nova] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 713.259560] env[70032]: INFO networking_nsxv3.common.synchronization [req-1f6b63d2-5845-46ee-b6ed-fc4609bff982 req-514a1b84-94b9-49e2-bc95-237f30b92b5c service nova] Enqueued Resource ID: 4b82a4bd-dcd2-449e-acf8-8a338709dc75 with Priority: HIGHEST for action port [ 713.261036] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 713.261151] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 713.261323] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b82a4bd-dcd2-449e-acf8-8a338709dc75 with Priority: HIGHEST for action port [ 713.262189] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.262374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.262374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.262603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.262827] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.263955] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.264258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.264258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.264372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.264783] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.264783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.264783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.264783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.265011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.265011] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.265923] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b82a4bd-dcd2-449e-acf8-8a338709dc75 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.266058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.266354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.266507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.266575] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b82a4bd-dcd2-449e-acf8-8a338709dc75',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.298353] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f4decdcf-ec57-4c3b-a19c-0128d47382b7 None None] Enqueued Resource ID: ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0 with Priority: HIGHEST for action port [ 713.299033] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0 with Priority: HIGHEST for action port [ 713.299133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.299251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.299909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.300432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.300432] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.486635] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aec392b7-965d-41cc-8638-44cc91b20d79 [ 713.486865] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.487029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.487108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.487305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.487637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.487637] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aec392b7-965d-41cc-8638-44cc91b20d79 already deleted. [ 713.487637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aec392b7-965d-41cc-8638-44cc91b20d79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.593993] env[70032]: INFO networking_nsxv3.common.synchronization [None req-849b9cda-d9c3-49ae-abed-2de2f81847cd None None] Enqueued Resource ID: b5c11f6a-4762-4811-be68-aa9ddf581fbd with Priority: HIGHEST for action port [ 713.593993] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5c11f6a-4762-4811-be68-aa9ddf581fbd with Priority: HIGHEST for action port [ 713.593993] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5c11f6a-4762-4811-be68-aa9ddf581fbd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.593993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5c11f6a-4762-4811-be68-aa9ddf581fbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.593993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5c11f6a-4762-4811-be68-aa9ddf581fbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.593993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5c11f6a-4762-4811-be68-aa9ddf581fbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.593993] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5c11f6a-4762-4811-be68-aa9ddf581fbd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.647509] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.715412] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.715723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.715723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.715827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.715926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.716136] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.716258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.716316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.716475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.716554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.716641] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f87689-4053-460b-b9e6-259755632006 is going to be updated. [ 713.747304] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.747478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.750048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.750048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.750048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.761370] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f87689-4053-460b-b9e6-259755632006 in Status: IN_PROGRESS for 2s [ 713.772025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.772025] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.772025] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b82a4bd-dcd2-449e-acf8-8a338709dc75 with status ACTIVE [ 713.772025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.772025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.772025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.778778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.779351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.779351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.779351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.779568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.779864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.779864] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b82a4bd-dcd2-449e-acf8-8a338709dc75 is going to be updated. [ 713.786898] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.787570] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.787570] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.787748] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.794014] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.794316] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.794506] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.794732] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.794894] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.795169] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.795289] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.795409] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.795519] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.795630] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.795734] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.795876] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.803240] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0 [ 713.803471] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.803719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.803719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.804429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.804429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.804429] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0 already deleted. [ 713.804429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae1c8c5c-6962-496f-86b3-9e4a8fd7c3b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.809991] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.810210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.810480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.810524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.810620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.810793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b82a4bd-dcd2-449e-acf8-8a338709dc75" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.819584] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.819736] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.819993] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.820114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.820410] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.820630] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.820728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.821090] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.821449] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c88842f-be38-41fe-a8ce-d3d4302d5ef3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.881855] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 713.881855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.881855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.881855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.881855] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.097591] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5c11f6a-4762-4811-be68-aa9ddf581fbd [ 714.097591] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.097591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.097591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.097591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.097591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.097591] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5c11f6a-4762-4811-be68-aa9ddf581fbd already deleted. [ 714.097591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5c11f6a-4762-4811-be68-aa9ddf581fbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.153483] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2ef9c9c-f8d6-4b45-b624-16d16cab2727: rpc.has_security_group_logging(os_id): False [ 714.171151] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.171151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.171151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.171151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.171151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.171426] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.171426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.171522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.171630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.171707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.171810] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 is going to be created. [ 714.270759] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.270981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.271062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.272885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.272885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.285526] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.285526] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: IN_PROGRESS for 2s [ 714.327371] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.329321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.329321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.332062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.332062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.332062] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7c88842f-be38-41fe-a8ce-d3d4302d5ef3 not found, creating... [ 714.332062] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.332062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.332062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.332062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.332062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.333760] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.333760] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.334114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.334704] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.335274] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.335274] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7c88842f-be38-41fe-a8ce-d3d4302d5ef3 is going to be created. [ 714.365360] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.365581] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.365707] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.365996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.366367] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.368305] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.383565] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.383750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.383750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.383972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.384176] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.384289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.384377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.384550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.384646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.384738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.384880] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.397374] env[70032]: INFO networking_nsxv3.common.synchronization [None req-7395c3a6-bcf3-44c3-b6af-d8a16a51085e None None] Enqueued Resource ID: c0d760ee-e47a-4170-90e4-30c639d858b1 with Priority: HIGHEST for action port [ 714.397907] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0d760ee-e47a-4170-90e4-30c639d858b1 with Priority: HIGHEST for action port [ 714.399577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0d760ee-e47a-4170-90e4-30c639d858b1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.399577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0d760ee-e47a-4170-90e4-30c639d858b1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.399577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0d760ee-e47a-4170-90e4-30c639d858b1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.399577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0d760ee-e47a-4170-90e4-30c639d858b1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.399577] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d760ee-e47a-4170-90e4-30c639d858b1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.724331] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54f2196-33e3-453f-a911-75188cea4a01 in Status: SUCCESS [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.724331] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.724331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.725056] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.788397] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.788556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.788613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.788826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.788924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.789044] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef is going to be created. [ 714.812115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.812285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.812337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.813851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.814124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.828112] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: UNINITIALIZED for 2s [ 714.889921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.889921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.889921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.890389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.890680] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.890908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.890908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.891053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.891143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.891234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.891417] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.894101] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.894101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.894101] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.901706] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0d760ee-e47a-4170-90e4-30c639d858b1 [ 714.901801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.901965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.902022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.902252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.902312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.902385] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0d760ee-e47a-4170-90e4-30c639d858b1 already deleted. [ 714.902625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0d760ee-e47a-4170-90e4-30c639d858b1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.229735] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54f2196-33e3-453f-a911-75188cea4a01 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.229889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.230102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.230245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.230396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.230471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.230533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.230677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.230764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.230848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.231065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54f2196-33e3-453f-a911-75188cea4a01 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.231267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.231267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.231355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.231511] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.231601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.231658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.231793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.231865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.231952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.232049] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.335041] env[70032]: INFO networking_nsxv3.common.synchronization [None req-bb9e7ff9-267e-4dec-b2db-c86b7d8cfacf None None] Enqueued Resource ID: 765d4da2-11b9-4f2c-af96-2df1fa525ab7 with Priority: HIGHEST for action port [ 715.335041] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 765d4da2-11b9-4f2c-af96-2df1fa525ab7 with Priority: HIGHEST for action port [ 715.335041] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-765d4da2-11b9-4f2c-af96-2df1fa525ab7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.335041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-765d4da2-11b9-4f2c-af96-2df1fa525ab7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.335319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-765d4da2-11b9-4f2c-af96-2df1fa525ab7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.335536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-765d4da2-11b9-4f2c-af96-2df1fa525ab7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.336656] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('765d4da2-11b9-4f2c-af96-2df1fa525ab7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.398312] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2546188-fcd4-4401-b075-87ffd0e4a9a9: rpc.has_security_group_logging(os_id): False [ 715.415279] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.416780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.416780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.416780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.416780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.416780] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.417060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.417060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.417124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.417467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.417705] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.417995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.418352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.418352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.418352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.418548] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.420793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.420793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.420793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.420793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.420793] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be updated. [ 715.479155] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.479520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.479842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.480187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.481949] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.498643] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: IN_PROGRESS for 2s [ 715.734187] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c54f2196-33e3-453f-a911-75188cea4a01: rpc.has_security_group_logging(os_id): False [ 715.748729] env[70032]: INFO networking_nsxv3.common.synchronization [req-900b440b-de98-4e37-bd39-5ab4463fae7c req-5993bb29-81b7-473b-9720-1252ee09a27a service nova] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_rules [ 715.748926] env[70032]: INFO networking_nsxv3.common.synchronization [req-900b440b-de98-4e37-bd39-5ab4463fae7c req-5993bb29-81b7-473b-9720-1252ee09a27a service nova] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 715.749075] env[70032]: INFO networking_nsxv3.common.synchronization [req-900b440b-de98-4e37-bd39-5ab4463fae7c req-5993bb29-81b7-473b-9720-1252ee09a27a service nova] Enqueued Resource ID: 7c88842f-be38-41fe-a8ce-d3d4302d5ef3 with Priority: HIGHEST for action port [ 715.749802] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_rules [ 715.749974] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 715.750178] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c88842f-be38-41fe-a8ce-d3d4302d5ef3 with Priority: HIGHEST for action port [ 715.751172] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.751340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.751413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.752623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.752623] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.753135] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.753135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.753135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.753135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.754816] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.754816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.754816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.754816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.755179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.755179] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.755784] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.755894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.755961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.756135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.756219] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c88842f-be38-41fe-a8ce-d3d4302d5ef3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.758420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.758420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.758420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.758643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.758749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.758925] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.759044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.759153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.759254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.759329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.759524] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.761545] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.761545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.761545] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c54f2196-33e3-453f-a911-75188cea4a01 is going to be created. [ 715.772275] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f87689-4053-460b-b9e6-259755632006 in Status: SUCCESS [ 715.772445] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f87689-4053-460b-b9e6-259755632006 deletion is rescheduled due to dependency. [ 715.772590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.820197] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.820289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.820328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.820574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.820893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.835095] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c54f2196-33e3-453f-a911-75188cea4a01 in Status: IN_PROGRESS for 2s [ 715.837495] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 765d4da2-11b9-4f2c-af96-2df1fa525ab7 [ 715.837781] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.838011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.839496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.839496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.839496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.839496] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:765d4da2-11b9-4f2c-af96-2df1fa525ab7 already deleted. [ 715.839496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-765d4da2-11b9-4f2c-af96-2df1fa525ab7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.262473] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.262830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.264496] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c88842f-be38-41fe-a8ce-d3d4302d5ef3 with status ACTIVE [ 716.264496] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.264982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.265141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.265398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.265528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.265805] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.265907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.265951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.266162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.266251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.266495] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.266630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.267078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.267239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.267311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.267406] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c88842f-be38-41fe-a8ce-d3d4302d5ef3 is going to be updated. [ 716.268557] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.288133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.288133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.288133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.288133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.289154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.289154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c88842f-be38-41fe-a8ce-d3d4302d5ef3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.296641] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: SUCCESS [ 716.296841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.622501] env[70032]: INFO networking_nsxv3.common.synchronization [None req-dec34a1a-920d-4553-b334-89622714d09c None None] Enqueued Resource ID: 47c5becd-5d81-4d5c-a05c-6921d1000f7d with Priority: HIGHEST for action port [ 716.622804] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c5becd-5d81-4d5c-a05c-6921d1000f7d with Priority: HIGHEST for action port [ 716.623420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-47c5becd-5d81-4d5c-a05c-6921d1000f7d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.623544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47c5becd-5d81-4d5c-a05c-6921d1000f7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.623609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47c5becd-5d81-4d5c-a05c-6921d1000f7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.623892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47c5becd-5d81-4d5c-a05c-6921d1000f7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.624021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c5becd-5d81-4d5c-a05c-6921d1000f7d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.772727] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.837362] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: SUCCESS [ 716.837581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.837804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.837961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.838294] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.838294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.838485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.838542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.838593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.839404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.839404] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.126100] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47c5becd-5d81-4d5c-a05c-6921d1000f7d [ 717.126875] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.127104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.128432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.128432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.128576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.128876] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47c5becd-5d81-4d5c-a05c-6921d1000f7d already deleted. [ 717.128876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47c5becd-5d81-4d5c-a05c-6921d1000f7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.280312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.280783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.280882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.281098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.281189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.281293] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be created. [ 717.309242] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.309402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.309476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.309689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.309849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.320034] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: UNINITIALIZED for 2s [ 717.345566] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.511828] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 717.512037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.700534] env[70032]: INFO networking_nsxv3.common.synchronization [req-962bb519-47c7-449a-9ed3-571e1b199211 req-15a2647f-01da-49db-9e00-ba4d7ed25730 tempest-MigrationsAdminTest-411767673 tempest-MigrationsAdminTest-411767673-project-member] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 717.700940] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 717.701775] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.702024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.702169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.703344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.704125] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.704125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.704125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.705250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.705250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.705250] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.850077] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb0f9ea3-e335-4804-8789-09a66f5ffeef: rpc.has_security_group_logging(os_id): False [ 717.850932] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c54f2196-33e3-453f-a911-75188cea4a01 in Status: SUCCESS [ 717.851354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.870865] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.870865] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.870865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.870865] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef is going to be created. [ 717.934898] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.935834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.935834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.935834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.935834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.946971] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: IN_PROGRESS for 2s [ 718.113164] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.114300] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.114300] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.114300] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.114508] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.114508] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.114746] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.114860] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.115094] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.115729] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.115856] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.115966] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.116095] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.116216] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.118874] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.119045] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.140388] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.140388] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.140388] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.140388] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.140388] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.140388] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.140388] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.141132] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.141132] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d78157b-4be6-4a5c-b7a8-2b58fe9bd242',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.207906] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.208059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.208111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.208289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.208396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.208600] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.208696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.208758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.209601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.209601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.209601] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e already deleted. [ 718.209601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.646620] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.646803] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.646937] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.648420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.648420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.648420] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 not found, creating... [ 718.648420] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.648420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.648420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.648420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.649060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.649060] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.649060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.650175] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.650175] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.650175] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.650572] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 is going to be created. [ 718.678559] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.678654] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.679678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.679678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.679678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.679678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.982787] env[70032]: INFO networking_nsxv3.common.synchronization [None req-642b1dee-0635-4215-9ca6-74707add8749 None None] Enqueued Resource ID: 440bf6e4-c3b3-4dca-91c9-e4b5c607ec31 with Priority: HIGHEST for action port [ 718.983082] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440bf6e4-c3b3-4dca-91c9-e4b5c607ec31 with Priority: HIGHEST for action port [ 718.983689] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-440bf6e4-c3b3-4dca-91c9-e4b5c607ec31 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.983790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-440bf6e4-c3b3-4dca-91c9-e4b5c607ec31" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.983951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-440bf6e4-c3b3-4dca-91c9-e4b5c607ec31" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.984910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-440bf6e4-c3b3-4dca-91c9-e4b5c607ec31" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.985130] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('440bf6e4-c3b3-4dca-91c9-e4b5c607ec31',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.332213] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: SUCCESS [ 719.332532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.332784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.333127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.333587] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.333681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.333756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.334560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.334971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.335161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.336368] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.487648] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 440bf6e4-c3b3-4dca-91c9-e4b5c607ec31 [ 719.487884] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.488084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.488195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.488432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.488519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.488619] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:440bf6e4-c3b3-4dca-91c9-e4b5c607ec31 already deleted. [ 719.488704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-440bf6e4-c3b3-4dca-91c9-e4b5c607ec31" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.734019] env[70032]: INFO networking_nsxv3.common.synchronization [req-962bb519-47c7-449a-9ed3-571e1b199211 req-0be9ce37-bc49-4da3-9ec9-242522ce7324 service nova] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_rules [ 719.734019] env[70032]: INFO networking_nsxv3.common.synchronization [req-962bb519-47c7-449a-9ed3-571e1b199211 req-0be9ce37-bc49-4da3-9ec9-242522ce7324 service nova] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 719.734019] env[70032]: INFO networking_nsxv3.common.synchronization [req-962bb519-47c7-449a-9ed3-571e1b199211 req-0be9ce37-bc49-4da3-9ec9-242522ce7324 service nova] Enqueued Resource ID: 0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 with Priority: HIGHEST for action port [ 719.734019] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_rules [ 719.734019] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 719.734019] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 with Priority: HIGHEST for action port [ 719.734019] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.734529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.734529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.734908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.735051] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.736136] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.736259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.736322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.736508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.736660] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.736755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.736817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.736961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.741734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.741734] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.741734] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.741734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.741734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.741734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.741734] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d78157b-4be6-4a5c-b7a8-2b58fe9bd242',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.842503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.842681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.842754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.842997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.843178] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.843300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.843349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.843517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.843605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.843692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.843838] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.843933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.844078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.845887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.845887] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.845887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.845887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.845887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.845887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.845887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.845887] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.960252] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: SUCCESS [ 719.960733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.215298] env[70032]: INFO networking_nsxv3.common.synchronization [req-b9a0529f-9b61-4e27-832c-7a9643cbcb26 req-9f2c3d33-c215-4ec3-9739-d0688fa8c170 tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 720.216612] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 720.217036] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.217571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.217675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.217943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.218123] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.218233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.218300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.218460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.218549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.218653] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.244424] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.244424] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.244424] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 with status ACTIVE [ 720.244424] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.244424] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.244424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.245169] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.245651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.245837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.246195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.246386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.246567] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d78157b-4be6-4a5c-b7a8-2b58fe9bd242 is going to be updated. [ 720.267991] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.267991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.267991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.267991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.267991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.267991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d78157b-4be6-4a5c-b7a8-2b58fe9bd242" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.348482] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8359b363-4508-4e0c-909f-bfb6605cb735: rpc.has_security_group_logging(os_id): False [ 720.369540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.369714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.369752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.370067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.370174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.370385] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.370482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.370543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.370700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.370776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.370971] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.371095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.371154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.371301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.371375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.371549] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.371639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.371699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.373997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.373997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.376093] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be created. [ 720.454110] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.454110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.454110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.454110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.454387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.466384] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: IN_PROGRESS for 2s [ 720.722992] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.722992] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.722992] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 already deleted. [ 720.722992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.749955] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.827092] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.827092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.827092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.827092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.827092] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.827092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.828531] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.828531] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.828889] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.829675] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.829675] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.833691] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.833691] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.833691] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.833691] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.833691] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.859627] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.859627] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.859627] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.859627] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.859627] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.859627] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.859627] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.859627] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.859627] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4935ae65-ccc0-47a8-8271-6ca8c4c672c1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.253490] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.253490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.253490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.253896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.253896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.253998] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be created. [ 721.277048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.277234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.277292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.277850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.277957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.287899] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: UNINITIALIZED for 2s [ 721.365705] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.365705] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 4935ae65-ccc0-47a8-8271-6ca8c4c672c1 not found, creating... [ 721.365705] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.365705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.366162] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.366523] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.366562] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.368331] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.368331] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.368331] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 4935ae65-ccc0-47a8-8271-6ca8c4c672c1 is going to be created. [ 721.387945] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.387945] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.388229] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.390051] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.390207] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.390483] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.217921] env[70032]: INFO networking_nsxv3.common.synchronization [req-b9a0529f-9b61-4e27-832c-7a9643cbcb26 req-441eaa25-c6d1-40a7-b9ac-08acaa3945a2 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 722.218219] env[70032]: INFO networking_nsxv3.common.synchronization [req-b9a0529f-9b61-4e27-832c-7a9643cbcb26 req-441eaa25-c6d1-40a7-b9ac-08acaa3945a2 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 722.218493] env[70032]: INFO networking_nsxv3.common.synchronization [req-b9a0529f-9b61-4e27-832c-7a9643cbcb26 req-441eaa25-c6d1-40a7-b9ac-08acaa3945a2 service nova] Enqueued Resource ID: 4935ae65-ccc0-47a8-8271-6ca8c4c672c1 with Priority: HIGHEST for action port [ 722.219254] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 722.219481] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 722.219648] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4935ae65-ccc0-47a8-8271-6ca8c4c672c1 with Priority: HIGHEST for action port [ 722.220085] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.220270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.220377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.220727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.220953] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.222896] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.222896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.222896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.223376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.223376] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.223574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.223574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.223718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.223979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.223979] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.229020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.229020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.229020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.229020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.229020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4935ae65-ccc0-47a8-8271-6ca8c4c672c1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.480348] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: SUCCESS [ 722.480652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.723464] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.723614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.731378] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4935ae65-ccc0-47a8-8271-6ca8c4c672c1 with status ACTIVE [ 722.731645] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.731724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.731798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.732092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.732192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.732377] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.732479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.732539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.732699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.732777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.732955] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.733060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.733122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.733269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.733347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.733421] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4935ae65-ccc0-47a8-8271-6ca8c4c672c1 is going to be updated. [ 722.735476] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.755184] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.755346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.755407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.755634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.755772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.755934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4935ae65-ccc0-47a8-8271-6ca8c4c672c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.847169] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf378eba-83e8-4551-887b-120c059364ed req-4a6353e5-6afe-466a-bed7-e5b299d4b892 tempest-ServerDiagnosticsTest-1474316937 tempest-ServerDiagnosticsTest-1474316937-project-member] Enqueued Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_members [ 722.847169] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGHEST for action security_group_members [ 722.847169] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.847169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.847169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.848835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.849046] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.849270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.849351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.849578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.849823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.849946] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.107616] env[70032]: INFO networking_nsxv3.common.synchronization [None req-7fd8b1a1-4979-44bf-aeb2-270dbc5ed321 None None] Enqueued Resource ID: 45ac8ead-27e2-4170-a84b-e2b658306e85 with Priority: HIGHEST for action port [ 723.108328] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ac8ead-27e2-4170-a84b-e2b658306e85 with Priority: HIGHEST for action port [ 723.109486] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ac8ead-27e2-4170-a84b-e2b658306e85 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.109900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ac8ead-27e2-4170-a84b-e2b658306e85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.110426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ac8ead-27e2-4170-a84b-e2b658306e85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.112459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ac8ead-27e2-4170-a84b-e2b658306e85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.112459] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ac8ead-27e2-4170-a84b-e2b658306e85',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.238401] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.296998] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 723.297232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.297389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.297598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.297785] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.297900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.297962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.298121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.298199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.298282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.298368] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.352732] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.352909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.352961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.353191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.353276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.353465] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.353557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.353614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.353758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.353829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.353913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 is going to be updated. [ 723.377779] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.377920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.377997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.378270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.378367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.386832] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 in Status: IN_PROGRESS for 2s [ 723.616027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45ac8ead-27e2-4170-a84b-e2b658306e85 [ 723.616027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.616027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.616027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.616027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.616027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.616027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45ac8ead-27e2-4170-a84b-e2b658306e85 already deleted. [ 723.616027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ac8ead-27e2-4170-a84b-e2b658306e85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.746731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.747488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.747488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.747488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.747488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.747488] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be created. [ 723.772798] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.772798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.772798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.772798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.772798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.782529] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: UNINITIALIZED for 2s [ 723.800226] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.800424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.800501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.800723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.800911] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.801073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.801151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.801316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.801465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.801512] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.801676] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.801770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.801832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.802027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.802185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.802245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.802280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.802416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.802491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.802571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.802660] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.306526] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1393cc3-6b9b-4326-8077-4648511fe41e: rpc.has_security_group_logging(os_id): False [ 724.323261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.323419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.323470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.323708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.323823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.324683] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.324792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.324915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.325054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.325136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.325394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.325448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.326029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.326029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.326029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.326029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.326029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.326029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.326490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.326490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.326490] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be created. [ 724.398030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.398030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.398030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.398030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.398030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.410293] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: IN_PROGRESS for 2s [ 725.397543] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 in Status: SUCCESS [ 725.397543] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 deletion is rescheduled due to dependency. [ 725.397543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.606602] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d22878c4-630d-4287-a08d-139a77a9e389 None None] Enqueued Resource ID: c3573c7b-be12-4de7-a085-13e4db0a1388 with Priority: HIGHEST for action port [ 725.606602] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3573c7b-be12-4de7-a085-13e4db0a1388 with Priority: HIGHEST for action port [ 725.606802] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3573c7b-be12-4de7-a085-13e4db0a1388 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.606924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3573c7b-be12-4de7-a085-13e4db0a1388" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.607014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3573c7b-be12-4de7-a085-13e4db0a1388" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.607280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3573c7b-be12-4de7-a085-13e4db0a1388" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.607358] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3573c7b-be12-4de7-a085-13e4db0a1388',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.794287] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 725.794569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.794761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.795031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.795296] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.795566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.795784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.796545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.796713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.796820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.796922] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.110200] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3573c7b-be12-4de7-a085-13e4db0a1388 [ 726.112020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.112020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.112020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.112020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.112020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.112020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3573c7b-be12-4de7-a085-13e4db0a1388 already deleted. [ 726.112020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3573c7b-be12-4de7-a085-13e4db0a1388" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.301939] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.301939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.302213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.302445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.302522] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.302618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.302682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.303637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.303637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.303637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.303637] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.303637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.303637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.307720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.308042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.308342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.308342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.308496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.308496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.308569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.308629] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.422595] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 726.422939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.811437] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac44685-7555-444d-b1ce-19ece671a825: rpc.has_security_group_logging(os_id): False [ 726.830674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.830894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.830942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.831180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.831445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.831535] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.831624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.832097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.832097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.832097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.832262] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.832373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.832439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.832657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.832756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.832968] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.837425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.837568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.837829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.837927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.838072] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be created. [ 726.873152] env[70032]: INFO networking_nsxv3.common.synchronization [req-fde7547c-7a75-4e01-b01c-dc39b22718c2 req-6ed18119-7da5-49a0-878d-bd9241324660 tempest-SecurityGroupRulesNegativeTestJSON-1034516022 tempest-SecurityGroupRulesNegativeTestJSON-1034516022-project-member] Enqueued Resource ID: df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 with Priority: HIGHEST for action security_group_rules [ 726.873627] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 with Priority: HIGHEST for action security_group_rules [ 726.873956] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.874110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.874163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.874410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.874501] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.893450] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.893610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.893682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.893899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.894122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.906775] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 727.396344] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.396503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.396582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.396796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.396893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.396988] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 already deleted. [ 727.397094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.860211] env[70032]: INFO networking_nsxv3.common.synchronization [req-99578ca1-1567-40b0-ac8d-67e0646a77e5 req-9a1bff6a-22c8-402d-9c91-e3da29f12eb6 tempest-TenantUsagesTestJSON-1205555066 tempest-TenantUsagesTestJSON-1205555066-project-member] Enqueued Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_members [ 727.860211] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_members [ 727.860211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5730a18-9b02-4aad-abe1-e7789de465fd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.860211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.860211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.860211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.861897] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.862098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.862172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.862339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.862436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.862546] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.276197] env[70032]: INFO networking_nsxv3.common.synchronization [None req-9043d279-e46a-487c-a23a-4cc86c52d235 None None] Enqueued Resource ID: 427a1960-6c6e-4deb-a8b7-872ec0074d3b with Priority: HIGHEST for action port [ 728.276197] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 427a1960-6c6e-4deb-a8b7-872ec0074d3b with Priority: HIGHEST for action port [ 728.276197] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-427a1960-6c6e-4deb-a8b7-872ec0074d3b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.276197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-427a1960-6c6e-4deb-a8b7-872ec0074d3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.276197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-427a1960-6c6e-4deb-a8b7-872ec0074d3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.276197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-427a1960-6c6e-4deb-a8b7-872ec0074d3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.276197] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('427a1960-6c6e-4deb-a8b7-872ec0074d3b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.356157] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.356157] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.356157] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.356157] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.356157] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.360020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.360167] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.360456] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.361532] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.361532] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.361532] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.361532] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.361532] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.361532] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.361532] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.362245] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.366080] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.366262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.366360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.366603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.366789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.366976] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.367150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.367244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.367628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.367628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.367628] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5730a18-9b02-4aad-abe1-e7789de465fd already deleted. [ 728.367824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.380416] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.380593] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.380734] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.380907] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.381288] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a58ec7de-f1eb-4349-b18a-baac5d133d8d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.381454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.381586] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.381900] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.382077] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a58ec7de-f1eb-4349-b18a-baac5d133d8d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.781942] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 427a1960-6c6e-4deb-a8b7-872ec0074d3b [ 728.781942] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.781942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.781942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.781942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.781942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.781942] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:427a1960-6c6e-4deb-a8b7-872ec0074d3b already deleted. [ 728.781942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-427a1960-6c6e-4deb-a8b7-872ec0074d3b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.885979] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.886314] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.886382] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.886681] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.886875] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.887085] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a58ec7de-f1eb-4349-b18a-baac5d133d8d not found, creating... [ 728.887358] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.887561] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.887699] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.887931] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.891793] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.891793] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.891793] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.891943] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.892213] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.892387] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.892518] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a58ec7de-f1eb-4349-b18a-baac5d133d8d is going to be created. [ 728.935908] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.936053] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.936216] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.936539] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.936771] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.937052] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.939974] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 728.939974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.998934] env[70032]: INFO networking_nsxv3.common.synchronization [req-dee1982d-2157-4a2c-8a2c-0be3d8a4212e req-14121870-1ce8-4bd2-a239-73f3ff969be6 tempest-SecurityGroupRulesNegativeTestJSON-1034516022 tempest-SecurityGroupRulesNegativeTestJSON-1034516022-project-member] Enqueued Resource ID: df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 with Priority: HIGHEST for action security_group_rules [ 728.999517] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 with Priority: HIGHEST for action security_group_rules [ 728.999832] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.999961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.000139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.000393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.000514] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.525923] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.526146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.526256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.526516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.526650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.526773] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66 already deleted. [ 729.526890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df8bdbe3-f2d6-4278-8d9e-d8dadaf40c66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.965403] env[70032]: INFO networking_nsxv3.common.synchronization [req-99578ca1-1567-40b0-ac8d-67e0646a77e5 req-10fcf946-5191-4825-8971-93740cba81e0 service nova] Enqueued Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_rules [ 729.965701] env[70032]: INFO networking_nsxv3.common.synchronization [req-99578ca1-1567-40b0-ac8d-67e0646a77e5 req-10fcf946-5191-4825-8971-93740cba81e0 service nova] Enqueued Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_members [ 729.965907] env[70032]: INFO networking_nsxv3.common.synchronization [req-99578ca1-1567-40b0-ac8d-67e0646a77e5 req-10fcf946-5191-4825-8971-93740cba81e0 service nova] Enqueued Resource ID: a58ec7de-f1eb-4349-b18a-baac5d133d8d with Priority: HIGHEST for action port [ 729.966554] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_rules [ 729.966740] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_members [ 729.966948] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58ec7de-f1eb-4349-b18a-baac5d133d8d with Priority: HIGHEST for action port [ 729.967322] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5730a18-9b02-4aad-abe1-e7789de465fd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.967519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.967654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.968007] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.968211] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.969295] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5730a18-9b02-4aad-abe1-e7789de465fd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.969472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.969582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.969856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.970077] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.970201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.970720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.970942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.971100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.971418] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.973038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a58ec7de-f1eb-4349-b18a-baac5d133d8d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.973471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.973596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.973830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.973922] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a58ec7de-f1eb-4349-b18a-baac5d133d8d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.240867] env[70032]: INFO networking_nsxv3.common.synchronization [None req-692bf079-0e42-495c-931a-87c174a21c0a None None] Enqueued Resource ID: 357d581d-10f9-4df4-8440-86ba0792e8a5 with Priority: HIGHEST for action port [ 730.240867] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357d581d-10f9-4df4-8440-86ba0792e8a5 with Priority: HIGHEST for action port [ 730.242369] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-357d581d-10f9-4df4-8440-86ba0792e8a5 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.243709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-357d581d-10f9-4df4-8440-86ba0792e8a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.243709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-357d581d-10f9-4df4-8440-86ba0792e8a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.246450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-357d581d-10f9-4df4-8440-86ba0792e8a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.246450] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('357d581d-10f9-4df4-8440-86ba0792e8a5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.314309] env[70032]: INFO networking_nsxv3.common.synchronization [req-bb9f118f-354b-43b7-8b67-0a2935a5b88e req-d935b532-a1b7-4c06-a2e3-81d69191a9b7 tempest-ServerAddressesNegativeTestJSON-206255264 tempest-ServerAddressesNegativeTestJSON-206255264-project-member] Enqueued Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_members [ 730.315032] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54f2196-33e3-453f-a911-75188cea4a01 with Priority: HIGHEST for action security_group_members [ 730.315229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54f2196-33e3-453f-a911-75188cea4a01 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.317472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.317472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.317472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.317472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.317472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.317472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.317472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.317472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.317472] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c54f2196-33e3-453f-a911-75188cea4a01',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.476584] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5730a18-9b02-4aad-abe1-e7789de465fd taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.476584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.476584] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.478131] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a58ec7de-f1eb-4349-b18a-baac5d133d8d with status ACTIVE [ 730.478131] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.478131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.478131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.478289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.478368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481557] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481557] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.481557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481557] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a58ec7de-f1eb-4349-b18a-baac5d133d8d is going to be updated. [ 730.504948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.504948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.504948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.505478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.505678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.505962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a58ec7de-f1eb-4349-b18a-baac5d133d8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.579681] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ec05f28f-7808-449d-a5f9-e5e4d35ae57d None None] Enqueued Resource ID: 6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5 with Priority: HIGHEST for action port [ 730.580230] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5 with Priority: HIGHEST for action port [ 730.580634] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.580634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.580766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.581032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.581587] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.747729] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 357d581d-10f9-4df4-8440-86ba0792e8a5 [ 730.750231] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.750231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.750231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.750231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.750231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.750231] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:357d581d-10f9-4df4-8440-86ba0792e8a5 already deleted. [ 730.750231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-357d581d-10f9-4df4-8440-86ba0792e8a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.820667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.821073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.821278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.821730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.821952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.822288] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.822566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.822754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.823062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.823879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.824029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54f2196-33e3-453f-a911-75188cea4a01 is going to be updated. [ 730.855212] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.855385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.855457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.855788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.855860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.865183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54f2196-33e3-453f-a911-75188cea4a01 in Status: IN_PROGRESS for 2s [ 730.982458] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.084568] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5 [ 731.085622] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.085761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.085806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.086617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.086617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.086617] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5 already deleted. [ 731.086617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d3fbd73-7ce6-46a1-ad88-c9fc0db5bad5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.490527] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.490789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.490936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.491281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.491676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.491676] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5730a18-9b02-4aad-abe1-e7789de465fd is going to be created. [ 731.519726] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.519726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.519726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.519726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.519726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.528512] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5730a18-9b02-4aad-abe1-e7789de465fd in Status: UNINITIALIZED for 2s [ 732.348625] env[70032]: INFO networking_nsxv3.common.synchronization [req-bcd5abcb-a097-4017-a72a-e31bd768c108 req-43f31cae-1a49-487a-8a34-529e86e54e00 tempest-FloatingIPsAssociationNegativeTestJSON-111942885 tempest-FloatingIPsAssociationNegativeTestJSON-111942885-project-member] Enqueued Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_members [ 732.349163] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGHEST for action security_group_members [ 732.349485] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.349564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.349669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.349818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.349960] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.350126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.350164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.350341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.350396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.350490] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.740434] env[70032]: INFO networking_nsxv3.common.synchronization [req-cb25f319-bf04-4e62-8101-50ada0b7ce26 req-0f8d3054-6b92-4ce9-b06e-c84d7a702592 tempest-ServerAddressesTestJSON-364535507 tempest-ServerAddressesTestJSON-364535507-project-member] Enqueued Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_members [ 732.741744] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_members [ 732.741744] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.741744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.742192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.742192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.743810] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.743810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.743810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.743810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.743810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.743810] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.852441] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.852628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.852710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.852968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.853097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.853335] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.853488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.853569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.853917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.853917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.854037] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61533d93-47dd-40b4-b191-9d366077f93c is going to be updated. [ 732.895662] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54f2196-33e3-453f-a911-75188cea4a01 in Status: SUCCESS [ 732.895915] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54f2196-33e3-453f-a911-75188cea4a01 deletion is rescheduled due to dependency. [ 732.896060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54f2196-33e3-453f-a911-75188cea4a01" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.912938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.912938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.913102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.914723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.914723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.925913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61533d93-47dd-40b4-b191-9d366077f93c in Status: IN_PROGRESS for 2s [ 733.046895] env[70032]: INFO networking_nsxv3.common.synchronization [None req-9db08147-8cad-4d5a-876c-2aa2f0826cf1 None None] Enqueued Resource ID: bf54ced6-5b26-4af2-9423-0a578ef0ce7e with Priority: HIGHEST for action port [ 733.046895] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf54ced6-5b26-4af2-9423-0a578ef0ce7e with Priority: HIGHEST for action port [ 733.048049] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf54ced6-5b26-4af2-9423-0a578ef0ce7e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.048259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf54ced6-5b26-4af2-9423-0a578ef0ce7e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.048347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf54ced6-5b26-4af2-9423-0a578ef0ce7e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.048674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf54ced6-5b26-4af2-9423-0a578ef0ce7e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.048741] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf54ced6-5b26-4af2-9423-0a578ef0ce7e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.245532] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.245691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.245769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.246420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.246420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.246420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.246881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.246881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.246881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.246881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.246881] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c252e10b-b1d9-4f18-a7ed-801f82010adb already deleted. [ 733.247042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.261526] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-499 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.261526] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-499" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.261526] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-499" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.261526] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-499" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.261877] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.261877] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.262032] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.262350] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.262543] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.262754] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.262868] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.262978] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.263101] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.263219] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.263327] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.263459] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.280757] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.280896] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.281047] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.281478] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-499" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.281836] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-401be66c-83ed-4c92-ad85-3fab1fe161de taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.282025] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.282148] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.282459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.282594] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('401be66c-83ed-4c92-ad85-3fab1fe161de',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.537898] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5730a18-9b02-4aad-abe1-e7789de465fd in Status: SUCCESS [ 733.539469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.539649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.539890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.540194] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.540346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.540450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.540594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.540678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.540772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.540986] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.553654] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf54ced6-5b26-4af2-9423-0a578ef0ce7e [ 733.553654] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.553654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.553654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.553654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.553654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.553654] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf54ced6-5b26-4af2-9423-0a578ef0ce7e already deleted. [ 733.554099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf54ced6-5b26-4af2-9423-0a578ef0ce7e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.575806] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c39324b9-d2f8-423c-b92d-9f5ef3e345d8 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_rules [ 733.575806] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_rules [ 733.575806] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.575806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.575806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.575806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.575806] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.767298] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1bfb7a54-a66c-4c35-961a-efbb0618cee3 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_rules [ 733.767298] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_rules [ 733.767298] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.767688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.785194] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.785447] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.785603] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.785919] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.786100] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.786261] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 401be66c-83ed-4c92-ad85-3fab1fe161de not found, creating... [ 733.786577] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.786784] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.786949] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.787555] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.787555] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.787555] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.788108] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.788108] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.789139] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.790563] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.790563] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 401be66c-83ed-4c92-ad85-3fab1fe161de is going to be created. [ 733.815030] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.815030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.815030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.815030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.815030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.815030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.046929] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5730a18-9b02-4aad-abe1-e7789de465fd taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.046929] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.046929] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5730a18-9b02-4aad-abe1-e7789de465fd taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.046929] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.046929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.047748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.047748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.047748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.047748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.047748] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.100418] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.100418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.103407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.103407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.103407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.103407] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 already deleted. [ 734.103407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.103407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.105451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.105451] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.558409] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5730a18-9b02-4aad-abe1-e7789de465fd: rpc.has_security_group_logging(os_id): False [ 734.580776] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.580972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.581354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.581354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.581354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.581544] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.581622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.581689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.581848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.581924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.582126] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.582515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.582515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.582515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.582515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.582716] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.582790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.582826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.582967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.584952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.585212] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5730a18-9b02-4aad-abe1-e7789de465fd is going to be created. [ 734.638190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.638394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.638467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.638725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.638789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.638872] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 already deleted. [ 734.638961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.680716] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.680864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.680941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.681191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.681344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.700318] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5730a18-9b02-4aad-abe1-e7789de465fd in Status: IN_PROGRESS for 2s [ 734.940953] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61533d93-47dd-40b4-b191-9d366077f93c in Status: SUCCESS [ 734.940953] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61533d93-47dd-40b4-b191-9d366077f93c deletion is rescheduled due to dependency. [ 734.940953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.987508] env[70032]: INFO networking_nsxv3.common.synchronization [req-cb25f319-bf04-4e62-8101-50ada0b7ce26 req-8d0c62d1-8643-4dad-a4a5-3d4d64ea96e5 service nova] Enqueued Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_rules [ 734.987693] env[70032]: INFO networking_nsxv3.common.synchronization [req-cb25f319-bf04-4e62-8101-50ada0b7ce26 req-8d0c62d1-8643-4dad-a4a5-3d4d64ea96e5 service nova] Enqueued Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_members [ 734.987859] env[70032]: INFO networking_nsxv3.common.synchronization [req-cb25f319-bf04-4e62-8101-50ada0b7ce26 req-8d0c62d1-8643-4dad-a4a5-3d4d64ea96e5 service nova] Enqueued Resource ID: 401be66c-83ed-4c92-ad85-3fab1fe161de with Priority: HIGHEST for action port [ 734.989299] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_rules [ 734.989463] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_members [ 734.989569] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401be66c-83ed-4c92-ad85-3fab1fe161de with Priority: HIGHEST for action port [ 734.989859] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.989985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.990066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.990329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.990418] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.994518] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.994518] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.994518] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.994518] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-401be66c-83ed-4c92-ad85-3fab1fe161de taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.994518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.994518] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('401be66c-83ed-4c92-ad85-3fab1fe161de',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.496931] env[70032]: INFO networking_nsxv3.common.synchronization [req-ebb316a9-e4a0-4ce4-a27d-627600fdc75b req-1ab776f9-3d1b-49e5-9abc-938c86fafaa1 tempest-ImagesOneServerTestJSON-283767551 tempest-ImagesOneServerTestJSON-283767551-project-member] Enqueued Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_members [ 735.496931] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_members [ 735.496931] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.496931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.496931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.496931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.496931] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.496931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.496931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.498206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.498838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.498838] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.499813] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.502600] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.502952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.506888] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 401be66c-83ed-4c92-ad85-3fab1fe161de with status ACTIVE [ 735.508599] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.508599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.508599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.508599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.508599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.508985] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.509138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.509323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.509582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.510470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.510470] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.510668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.510773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.510979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.511203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.511364] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 401be66c-83ed-4c92-ad85-3fab1fe161de is going to be updated. [ 735.532583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.532774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.532817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.533044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.533219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.533407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-401be66c-83ed-4c92-ad85-3fab1fe161de" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.002646] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.014757] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.014928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.014977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.015296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.015392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.015589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.015688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.015794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.015906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.016047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.016104] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c already deleted. [ 736.016176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.220854] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.221029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-252" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.221190] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-252" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.221504] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-252" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.221762] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.221927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.222345] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.222674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.222903] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.223143] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.223317] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.223480] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.223667] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.223862] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.224037] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.224331] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.242337] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.242661] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.242862] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.243122] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-252" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.243499] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-04f93b25-2ac0-4d63-8d30-027e481506e2 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.243741] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.243956] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.244345] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.244553] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f93b25-2ac0-4d63-8d30-027e481506e2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.506020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.506020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.506202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.506322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.506414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.506513] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c252e10b-b1d9-4f18-a7ed-801f82010adb is going to be created. [ 736.528754] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.528938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.529063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.529293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.529448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.539022] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c252e10b-b1d9-4f18-a7ed-801f82010adb in Status: UNINITIALIZED for 2s [ 736.713163] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5730a18-9b02-4aad-abe1-e7789de465fd in Status: SUCCESS [ 736.713163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.752857] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.753153] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.753287] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.753560] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.753706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.754221] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 04f93b25-2ac0-4d63-8d30-027e481506e2 not found, creating... [ 736.754525] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.754811] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.754937] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.755192] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.755351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.755629] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.755788] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.755910] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.756596] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.756757] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.756906] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 04f93b25-2ac0-4d63-8d30-027e481506e2 is going to be created. [ 736.775580] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.775889] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.776097] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.776420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.776756] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.777014] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.885295] env[70032]: INFO networking_nsxv3.common.synchronization [None req-856b6752-4722-4597-8c45-025fe2ede64d None None] Enqueued Resource ID: 0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb with Priority: HIGHEST for action port [ 736.885295] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb with Priority: HIGHEST for action port [ 736.885295] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.885295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.885295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.885295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.885295] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.009031] env[70032]: INFO networking_nsxv3.common.synchronization [req-7676e67c-84ae-409b-bfe4-a8038c148ac1 req-aefd6d6f-8364-401f-8185-b08cef1424c1 tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 737.009031] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 737.009031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.009031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.009550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.009550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.009550] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.009655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.009688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.009935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.009935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.010052] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.390310] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb [ 737.390310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.390310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.390310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.390310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.390310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.390634] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb already deleted. [ 737.390634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a352cd0-fe2f-4f05-b7cc-ef6749dcd5bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.511877] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.512073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.512157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.516020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.516020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.516020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.516020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.516020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.516020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.516020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.516020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 737.541698] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.541863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.541922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.542170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.542320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.550455] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 737.839688] env[70032]: INFO networking_nsxv3.common.synchronization [req-8d0bfb3a-c63e-47f0-b3ad-49bdb1b8c26a req-1a8cd900-d14e-40bc-8b68-3e2ca6ce621b tempest-AttachInterfacesV270Test-579139546 tempest-AttachInterfacesV270Test-579139546-project-member] Enqueued Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_members [ 737.840240] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_members [ 737.840625] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.840755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.840814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.843626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.843850] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.844063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.844063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.844321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.844418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.844513] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.348226] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.348226] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.348226] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 465b2315-38b5-4037-b159-5d8565fe0f2f already deleted. [ 738.348226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.501060] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.501060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-105" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.501060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-105" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.501060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-105" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.501060] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.501060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.501060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.502236] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.502579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.502932] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.503242] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.503513] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.505131] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.505131] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.505131] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.505131] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.525069] env[70032]: INFO networking_nsxv3.common.synchronization [req-ebb316a9-e4a0-4ce4-a27d-627600fdc75b req-354f995f-f374-47e3-9676-629dc7403f3e service nova] Enqueued Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_rules [ 738.525069] env[70032]: INFO networking_nsxv3.common.synchronization [req-ebb316a9-e4a0-4ce4-a27d-627600fdc75b req-354f995f-f374-47e3-9676-629dc7403f3e service nova] Enqueued Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_members [ 738.525069] env[70032]: INFO networking_nsxv3.common.synchronization [req-ebb316a9-e4a0-4ce4-a27d-627600fdc75b req-354f995f-f374-47e3-9676-629dc7403f3e service nova] Enqueued Resource ID: 04f93b25-2ac0-4d63-8d30-027e481506e2 with Priority: HIGHEST for action port [ 738.525656] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.526322] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.526322] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.526322] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-105" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.526942] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-2cd410f4-68da-4528-913b-3b1956977ef9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.527351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.527351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.528728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.528921] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd410f4-68da-4528-913b-3b1956977ef9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.530235] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_rules [ 738.530403] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_members [ 738.530631] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04f93b25-2ac0-4d63-8d30-027e481506e2 with Priority: HIGHEST for action port [ 738.530893] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.530980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.531045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.531294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.531379] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.532831] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.533022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.533141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.533362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.537034] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.537034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.537034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.537034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.537319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.537319] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.537949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-04f93b25-2ac0-4d63-8d30-027e481506e2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.538063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.538134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.538308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.538384] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f93b25-2ac0-4d63-8d30-027e481506e2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.549707] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c252e10b-b1d9-4f18-a7ed-801f82010adb in Status: SUCCESS [ 738.551882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.551882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.551983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.552233] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.552823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.552823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.552823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.552972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.553175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.553356] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.044353] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.044353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.044353] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.044353] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.044353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.044353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.044353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.044353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.044353] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 2cd410f4-68da-4528-913b-3b1956977ef9 not found, creating... [ 739.044765] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.044765] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.047690] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.048071] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.048249] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.048656] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.048824] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.049703] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.049703] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.049703] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.049703] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 2cd410f4-68da-4528-913b-3b1956977ef9 is going to be created. [ 739.057351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.058701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.058701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.058701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.058701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.058701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.058701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.059193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.059379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.060380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.060380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.060380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.060380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.060380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.060380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.061886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.061959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.062233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.062271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.062413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.062475] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.063423] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04f93b25-2ac0-4d63-8d30-027e481506e2 with status ACTIVE [ 739.063517] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.063616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.063675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.064180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.064285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.064465] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.064574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.064704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.064823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.064897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.065103] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.065215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.065273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.065421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.065752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.065752] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04f93b25-2ac0-4d63-8d30-027e481506e2 is going to be updated. [ 739.069330] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.069527] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.070064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.070522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.070785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.071016] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.085050] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.085226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.085289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.085502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.085661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.085861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04f93b25-2ac0-4d63-8d30-027e481506e2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.344686] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ea1d486b-37c1-473d-8b88-afcf2bc1fe4f None None] Enqueued Resource ID: 60d58ee8-51c6-4415-9563-23e1b801b67e with Priority: HIGHEST for action port [ 739.345313] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d58ee8-51c6-4415-9563-23e1b801b67e with Priority: HIGHEST for action port [ 739.345665] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-60d58ee8-51c6-4415-9563-23e1b801b67e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.345789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60d58ee8-51c6-4415-9563-23e1b801b67e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.345863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60d58ee8-51c6-4415-9563-23e1b801b67e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.346243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60d58ee8-51c6-4415-9563-23e1b801b67e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.346243] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60d58ee8-51c6-4415-9563-23e1b801b67e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.552966] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.562915] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 739.563198] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 739.563307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.567680] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c252e10b-b1d9-4f18-a7ed-801f82010adb: rpc.has_security_group_logging(os_id): False [ 739.588267] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.588859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.588859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.588859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.588859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.589131] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.589321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.589377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.589556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.589677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.589999] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.590175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.590281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.590516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.590727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.590910] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.591480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.591627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.591733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.591842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.591900] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c252e10b-b1d9-4f18-a7ed-801f82010adb is going to be created. [ 739.645674] env[70032]: INFO networking_nsxv3.common.synchronization [None req-6c71e7c6-61c6-4287-9757-5769cb6b0367 None None] Enqueued Resource ID: 2b9df4fe-579e-4110-a031-f5eecc42234a with Priority: HIGHEST for action port [ 739.646671] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9df4fe-579e-4110-a031-f5eecc42234a with Priority: HIGHEST for action port [ 739.646671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9df4fe-579e-4110-a031-f5eecc42234a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.646823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9df4fe-579e-4110-a031-f5eecc42234a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.646823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9df4fe-579e-4110-a031-f5eecc42234a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.648368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9df4fe-579e-4110-a031-f5eecc42234a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.648495] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9df4fe-579e-4110-a031-f5eecc42234a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.674109] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.674341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.674414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.674628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.674813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.698982] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c252e10b-b1d9-4f18-a7ed-801f82010adb in Status: IN_PROGRESS for 2s [ 739.854426] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60d58ee8-51c6-4415-9563-23e1b801b67e [ 739.854682] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.854901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.854901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.855155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.855242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.855339] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60d58ee8-51c6-4415-9563-23e1b801b67e already deleted. [ 739.855421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60d58ee8-51c6-4415-9563-23e1b801b67e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.057994] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.057994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.057994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.057994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.057994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.057994] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c is going to be created. [ 740.085040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.085040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.085040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.085040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.085040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.095453] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c in Status: UNINITIALIZED for 2s [ 740.152159] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b9df4fe-579e-4110-a031-f5eecc42234a [ 740.152432] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.152634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.152696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.152943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.153925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.153925] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b9df4fe-579e-4110-a031-f5eecc42234a already deleted. [ 740.153925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9df4fe-579e-4110-a031-f5eecc42234a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.347648] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1a91dfd3-5740-49c9-9aa1-41bcdd00110d None None] Enqueued Resource ID: 8cee931b-ada8-4178-bc9e-8d8d3ea7da8d with Priority: HIGHEST for action port [ 740.348047] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cee931b-ada8-4178-bc9e-8d8d3ea7da8d with Priority: HIGHEST for action port [ 740.348537] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cee931b-ada8-4178-bc9e-8d8d3ea7da8d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.348655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cee931b-ada8-4178-bc9e-8d8d3ea7da8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.348721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cee931b-ada8-4178-bc9e-8d8d3ea7da8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.349657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cee931b-ada8-4178-bc9e-8d8d3ea7da8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.352216] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cee931b-ada8-4178-bc9e-8d8d3ea7da8d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.588841] env[70032]: INFO networking_nsxv3.common.synchronization [req-21daf8b2-e1e0-4e83-ae00-fcb303ad9e42 req-600549c5-7387-470c-bab6-6a3e40e3face tempest-ServersTestFqdnHostnames-1197439368 tempest-ServersTestFqdnHostnames-1197439368-project-member] Enqueued Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_members [ 740.589434] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_members [ 740.592487] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20098c3-4944-4612-af2a-f2d01874388d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.592762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.592837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.594033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.594280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.594427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.594511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.594755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.594828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.594955] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.710745] env[70032]: INFO networking_nsxv3.common.synchronization [req-8d0bfb3a-c63e-47f0-b3ad-49bdb1b8c26a req-21475d54-82bf-40a5-b92d-a5d1a7741c5f service nova] Enqueued Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_rules [ 740.711090] env[70032]: INFO networking_nsxv3.common.synchronization [req-8d0bfb3a-c63e-47f0-b3ad-49bdb1b8c26a req-21475d54-82bf-40a5-b92d-a5d1a7741c5f service nova] Enqueued Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_members [ 740.711156] env[70032]: INFO networking_nsxv3.common.synchronization [req-8d0bfb3a-c63e-47f0-b3ad-49bdb1b8c26a req-21475d54-82bf-40a5-b92d-a5d1a7741c5f service nova] Enqueued Resource ID: 2cd410f4-68da-4528-913b-3b1956977ef9 with Priority: HIGHEST for action port [ 740.711359] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_rules [ 740.711557] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_members [ 740.711632] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cd410f4-68da-4528-913b-3b1956977ef9 with Priority: HIGHEST for action port [ 740.716346] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.716519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.716519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.716810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.716867] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.718644] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.718644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.718644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.718644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.718644] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.718644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.718644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.719424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.719424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.719424] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.724618] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cd410f4-68da-4528-913b-3b1956977ef9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.724760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.724831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.725601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.725601] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd410f4-68da-4528-913b-3b1956977ef9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.861050] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cee931b-ada8-4178-bc9e-8d8d3ea7da8d [ 740.861050] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.861050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.861050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.861050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.861050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.861050] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cee931b-ada8-4178-bc9e-8d8d3ea7da8d already deleted. [ 740.861050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cee931b-ada8-4178-bc9e-8d8d3ea7da8d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.100750] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.100914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.100965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.101203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.101302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.101485] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.101581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.101681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.102043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.102043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.102043] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20098c3-4944-4612-af2a-f2d01874388d already deleted. [ 741.102043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.226865] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.227052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.232418] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.233413] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cd410f4-68da-4528-913b-3b1956977ef9 with status ACTIVE [ 741.234220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.234220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.234220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.234220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.234220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.234546] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.234546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.234546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.234707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.234785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.235439] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.235439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.235439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.235439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.235661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.235661] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cd410f4-68da-4528-913b-3b1956977ef9 is going to be updated. [ 741.259718] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.259718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.259718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.259718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.259718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.259718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cd410f4-68da-4528-913b-3b1956977ef9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.269032] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.269032] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.269032] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.269334] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.269434] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.269582] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.269700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.269915] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.270777] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.271182] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.271344] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.271468] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.271581] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.271864] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 741.272017] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.272148] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.292166] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.292166] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 741.292166] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.292166] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.292606] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-066c4a84-02ae-4344-b513-6ae550dc9f38 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.292722] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.292775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.293110] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.293248] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('066c4a84-02ae-4344-b513-6ae550dc9f38',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.713332] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c252e10b-b1d9-4f18-a7ed-801f82010adb in Status: SUCCESS [ 741.713332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.739129] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.800375] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.800375] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.800375] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.800375] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.800375] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.800739] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 066c4a84-02ae-4344-b513-6ae550dc9f38 not found, creating... [ 741.800739] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.800889] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.801121] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.801254] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.802715] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.802715] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.802715] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.802715] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.803917] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.805722] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.805722] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 066c4a84-02ae-4344-b513-6ae550dc9f38 is going to be created. [ 741.824783] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.825019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.825164] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.825470] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.825697] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.825914] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.109935] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c in Status: SUCCESS [ 742.110257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.110424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.110648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.110839] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.111354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.111459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.113019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.113019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.113019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.113019] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.119024] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ac32b2ac-9c71-448e-8d6d-efb52c3dc0e6 None None] Enqueued Resource ID: cb71b17e-c213-4241-bf0e-e242752a3f25 with Priority: HIGHEST for action port [ 742.119024] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb71b17e-c213-4241-bf0e-e242752a3f25 with Priority: HIGHEST for action port [ 742.119024] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb71b17e-c213-4241-bf0e-e242752a3f25 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.119024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb71b17e-c213-4241-bf0e-e242752a3f25" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.119024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb71b17e-c213-4241-bf0e-e242752a3f25" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.119024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb71b17e-c213-4241-bf0e-e242752a3f25" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.119024] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb71b17e-c213-4241-bf0e-e242752a3f25',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.241865] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.242268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.242407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.242806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.243224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.243224] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 465b2315-38b5-4037-b159-5d8565fe0f2f is going to be created. [ 742.269719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.269857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.269857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.270900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.270900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.279986] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 465b2315-38b5-4037-b159-5d8565fe0f2f in Status: UNINITIALIZED for 2s [ 742.617392] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.617575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.617719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.617930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.618131] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.618249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.618298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.618466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.618555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.618647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.618795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.618886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.618947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.619119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.619261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.619352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.619410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.619545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.619623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.619711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.619801] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.622054] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb71b17e-c213-4241-bf0e-e242752a3f25 [ 742.622280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.622439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.622536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.622766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.622882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.623028] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb71b17e-c213-4241-bf0e-e242752a3f25 already deleted. [ 742.623150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb71b17e-c213-4241-bf0e-e242752a3f25" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.827451] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c68b33b6-7580-4450-8114-bb9307b84ec1 None None] Enqueued Resource ID: a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7 with Priority: HIGHEST for action port [ 742.829386] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7 with Priority: HIGHEST for action port [ 742.829386] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.829386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.829386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.829386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.829386] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.888854] env[70032]: INFO networking_nsxv3.common.synchronization [req-21daf8b2-e1e0-4e83-ae00-fcb303ad9e42 req-10b43381-1145-4884-9ee2-cd8fda12497f service nova] Enqueued Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_rules [ 742.888854] env[70032]: INFO networking_nsxv3.common.synchronization [req-21daf8b2-e1e0-4e83-ae00-fcb303ad9e42 req-10b43381-1145-4884-9ee2-cd8fda12497f service nova] Enqueued Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_members [ 742.889178] env[70032]: INFO networking_nsxv3.common.synchronization [req-21daf8b2-e1e0-4e83-ae00-fcb303ad9e42 req-10b43381-1145-4884-9ee2-cd8fda12497f service nova] Enqueued Resource ID: 066c4a84-02ae-4344-b513-6ae550dc9f38 with Priority: HIGHEST for action port [ 742.889570] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_rules [ 742.889787] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_members [ 742.889978] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066c4a84-02ae-4344-b513-6ae550dc9f38 with Priority: HIGHEST for action port [ 742.890282] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b20098c3-4944-4612-af2a-f2d01874388d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.890424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.890533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.890874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.890874] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.893048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20098c3-4944-4612-af2a-f2d01874388d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.893191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.893297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.893569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.893777] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.893900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.893969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.894216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.894366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.894526] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.899030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-066c4a84-02ae-4344-b513-6ae550dc9f38 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.899030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.899030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.899030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.899030] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('066c4a84-02ae-4344-b513-6ae550dc9f38',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.126095] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e94337d-b9be-48c8-8c35-01c45e2baf7c: rpc.has_security_group_logging(os_id): False [ 743.144015] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.144015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.144015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.144284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.144338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.145297] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.145297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.145297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.145297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.145297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.145692] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.145692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.145692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.145820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.145858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.146373] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.146373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.146373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.146594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.146637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.148047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c is going to be created. [ 743.230117] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.230824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.230824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.230824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.230824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.249623] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c in Status: IN_PROGRESS for 2s [ 743.333109] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7 [ 743.333251] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.333771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.333771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.333771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.333771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.333958] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7 already deleted. [ 743.333958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7fafe7f-ec5b-43b6-8600-14b4c8ca15e7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.398058] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.401830] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20098c3-4944-4612-af2a-f2d01874388d taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.401830] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 066c4a84-02ae-4344-b513-6ae550dc9f38 with status ACTIVE [ 743.401830] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.401830] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.401830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.402816] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.402816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.402816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.402816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.402816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.402816] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 066c4a84-02ae-4344-b513-6ae550dc9f38 is going to be updated. [ 743.428379] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.428567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.428641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.428852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.428992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.429173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-066c4a84-02ae-4344-b513-6ae550dc9f38" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.783819] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b6a2d75d-311e-47af-864b-8d5ed3671ca6 None None] Enqueued Resource ID: 780ba767-5397-4733-86d8-c282f6c3e811 with Priority: HIGHEST for action port [ 743.785141] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 780ba767-5397-4733-86d8-c282f6c3e811 with Priority: HIGHEST for action port [ 743.785141] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-780ba767-5397-4733-86d8-c282f6c3e811 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.785340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-780ba767-5397-4733-86d8-c282f6c3e811" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.785383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-780ba767-5397-4733-86d8-c282f6c3e811" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.785735] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-780ba767-5397-4733-86d8-c282f6c3e811" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.787101] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('780ba767-5397-4733-86d8-c282f6c3e811',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.909052] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.158109] env[70032]: INFO networking_nsxv3.common.synchronization [req-cc630e1d-59b9-4e18-a6b1-3c7e488774ba req-d8f311f9-3a62-480a-a593-8cdbbaee6d72 tempest-TenantUsagesTestJSON-1205555066 tempest-TenantUsagesTestJSON-1205555066-project-member] Enqueued Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_members [ 744.158686] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5730a18-9b02-4aad-abe1-e7789de465fd with Priority: HIGHEST for action security_group_members [ 744.159077] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5730a18-9b02-4aad-abe1-e7789de465fd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.159900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.159975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.160205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.160370] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.160532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.160594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.162266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.162266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.162266] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5730a18-9b02-4aad-abe1-e7789de465fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.290902] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 465b2315-38b5-4037-b159-5d8565fe0f2f in Status: SUCCESS [ 744.291141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.291672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.291885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.292093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.293931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.294016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.294256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.294358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.294563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.294563] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.297098] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 780ba767-5397-4733-86d8-c282f6c3e811 [ 744.297098] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.297098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.297098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.297098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.297353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.297353] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:780ba767-5397-4733-86d8-c282f6c3e811 already deleted. [ 744.297353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-780ba767-5397-4733-86d8-c282f6c3e811" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.411147] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.412516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.412516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.412516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.412516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.412516] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20098c3-4944-4612-af2a-f2d01874388d is going to be created. [ 744.442723] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.442932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.442932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.443569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.443569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.454796] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20098c3-4944-4612-af2a-f2d01874388d in Status: UNINITIALIZED for 2s [ 744.663162] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.663162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.663162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.663370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.663752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.663752] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.663752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.663976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.663976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.664073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.664115] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5730a18-9b02-4aad-abe1-e7789de465fd is going to be updated. [ 744.725306] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.725461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.725524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.725737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.725877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.751618] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5730a18-9b02-4aad-abe1-e7789de465fd in Status: IN_PROGRESS for 2s [ 744.801714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.801869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.801992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.802245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.802428] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.802534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.802596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.802912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.802912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.803026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.803097] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.803191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.803253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.803408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.803601] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.803671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.803734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.803876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.803953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.804046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.804161] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.262208] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c in Status: SUCCESS [ 745.263136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.310026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 465b2315-38b5-4037-b159-5d8565fe0f2f: rpc.has_security_group_logging(os_id): False [ 745.327747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.327919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.327993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.328266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.328861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.330394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.330566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.330727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.330975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.331099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.331346] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.331479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.331568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.331765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.331853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.332285] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.332285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.332285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.332580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.332580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.332580] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 465b2315-38b5-4037-b159-5d8565fe0f2f is going to be created. [ 745.400450] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.400768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.400768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.402239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.402239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.415047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 465b2315-38b5-4037-b159-5d8565fe0f2f in Status: IN_PROGRESS for 2s [ 746.130609] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e4d32d-ebaf-43da-bd4e-aa658f6b07f5 req-da02e754-19b7-475f-83b1-a7b573da50c1 tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 746.131133] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 746.131444] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.131581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.131657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.131935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.134482] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.134482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.134482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.134927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.134927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.134927] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.464914] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20098c3-4944-4612-af2a-f2d01874388d in Status: SUCCESS [ 746.465684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.465684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.465684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.465898] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.465969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.466016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.466178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.466307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.466462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.466599] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.565744] env[70032]: INFO networking_nsxv3.common.synchronization [None req-651764d6-46d5-460d-ad68-82593884a281 None None] Enqueued Resource ID: f21b2e81-1ba4-46e1-a0f1-ad9779a0e102 with Priority: HIGHEST for action port [ 746.565744] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f21b2e81-1ba4-46e1-a0f1-ad9779a0e102 with Priority: HIGHEST for action port [ 746.565744] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f21b2e81-1ba4-46e1-a0f1-ad9779a0e102 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.565744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f21b2e81-1ba4-46e1-a0f1-ad9779a0e102" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.565744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f21b2e81-1ba4-46e1-a0f1-ad9779a0e102" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.565744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f21b2e81-1ba4-46e1-a0f1-ad9779a0e102" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.565744] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f21b2e81-1ba4-46e1-a0f1-ad9779a0e102',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.638707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.638707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.638707] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae already deleted. [ 746.638707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.760371] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5730a18-9b02-4aad-abe1-e7789de465fd in Status: SUCCESS [ 746.760519] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5730a18-9b02-4aad-abe1-e7789de465fd deletion is rescheduled due to dependency. [ 746.760640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5730a18-9b02-4aad-abe1-e7789de465fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.970824] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.977198] env[70032]: INFO networking_nsxv3.common.synchronization [req-60277b0b-d74d-4c08-8e82-c7e219364d6c req-ae6fdd95-2876-42ef-8ee1-131993742bc6 tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 746.981574] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 746.981574] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.981574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.981574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.981574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.981574] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.981574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.981574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.981574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.981574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.981574] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.068632] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f21b2e81-1ba4-46e1-a0f1-ad9779a0e102 [ 747.068806] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.069233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.069233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.069364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.069364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.069499] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f21b2e81-1ba4-46e1-a0f1-ad9779a0e102 already deleted. [ 747.069499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f21b2e81-1ba4-46e1-a0f1-ad9779a0e102" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.434493] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 465b2315-38b5-4037-b159-5d8565fe0f2f in Status: SUCCESS [ 747.434737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.439982] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.440196] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.440356] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.440688] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.440950] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.441126] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.441244] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.441459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.441602] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.441807] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.441920] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.442043] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.442152] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.442312] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.442376] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.442522] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.459962] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.460598] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 747.460598] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.460598] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.460791] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.460933] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.461067] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.461404] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.461546] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7e2ea97-1d4c-4f01-ab44-d5235784a05d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.473208] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b20098c3-4944-4612-af2a-f2d01874388d: rpc.has_security_group_logging(os_id): False [ 747.484630] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.484782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.484852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.485541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.485541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.485541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.485541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.485541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.485762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.485762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.485831] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 747.496077] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.496229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.496319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.496557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.496934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.497460] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.497604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.497674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.497840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.497926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.498033] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b20098c3-4944-4612-af2a-f2d01874388d is going to be created. [ 747.534761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.534761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.534761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.534761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.534761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.544079] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 747.563301] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.563466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.563545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.563778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.564596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.577503] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b20098c3-4944-4612-af2a-f2d01874388d in Status: IN_PROGRESS for 2s [ 747.963638] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.965374] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.965554] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.965934] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.966021] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.966352] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port f7e2ea97-1d4c-4f01-ab44-d5235784a05d not found, creating... [ 747.966685] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.966881] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.966984] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.967388] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.967564] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.967864] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.968088] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.968194] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.969177] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.969951] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.970176] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: f7e2ea97-1d4c-4f01-ab44-d5235784a05d is going to be created. [ 747.992261] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.992544] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.992544] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.993471] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.993471] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.993471] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.325201] env[70032]: INFO networking_nsxv3.common.synchronization [None req-9b3f3995-cd18-4a4e-8077-1f7319792c05 None None] Enqueued Resource ID: 3062ec85-1218-415c-a09e-c1bd5b5e8e70 with Priority: HIGHEST for action port [ 748.325201] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3062ec85-1218-415c-a09e-c1bd5b5e8e70 with Priority: HIGHEST for action port [ 748.325201] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3062ec85-1218-415c-a09e-c1bd5b5e8e70 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.325201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3062ec85-1218-415c-a09e-c1bd5b5e8e70" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.325201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3062ec85-1218-415c-a09e-c1bd5b5e8e70" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.325201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3062ec85-1218-415c-a09e-c1bd5b5e8e70" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.325201] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3062ec85-1218-415c-a09e-c1bd5b5e8e70',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.631294] env[70032]: INFO networking_nsxv3.common.synchronization [req-18c6dc50-463f-420b-9338-21df303106ca req-f06e9513-ad7c-447d-8f17-e708eee93cf0 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 748.631852] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 748.632208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.632337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.632402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.632649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.632814] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.632926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.633052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.635292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.635387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.635489] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.828375] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3062ec85-1218-415c-a09e-c1bd5b5e8e70 [ 748.828629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.828834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.828834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.829859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.829859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.829859] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3062ec85-1218-415c-a09e-c1bd5b5e8e70 already deleted. [ 748.829859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3062ec85-1218-415c-a09e-c1bd5b5e8e70" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.142027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.142027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.142027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa already deleted. [ 749.142027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.179950] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e4d32d-ebaf-43da-bd4e-aa658f6b07f5 req-c93633bb-67c1-4401-805d-0bf182c40b5c service nova] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_rules [ 749.180289] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e4d32d-ebaf-43da-bd4e-aa658f6b07f5 req-c93633bb-67c1-4401-805d-0bf182c40b5c service nova] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 749.180641] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e4d32d-ebaf-43da-bd4e-aa658f6b07f5 req-c93633bb-67c1-4401-805d-0bf182c40b5c service nova] Enqueued Resource ID: f7e2ea97-1d4c-4f01-ab44-d5235784a05d with Priority: HIGHEST for action port [ 749.181929] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_rules [ 749.181929] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 749.181929] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2ea97-1d4c-4f01-ab44-d5235784a05d with Priority: HIGHEST for action port [ 749.184667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.184667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.184667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.184667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.184667] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.184667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.190256] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.190256] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.190256] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.190256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.190256] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7e2ea97-1d4c-4f01-ab44-d5235784a05d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.366217] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.366217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-733" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.366217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-733" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.366217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-733" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.366217] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.366217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.369785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.369785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.369785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.372845] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.372845] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.372845] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.372845] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.372845] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.372845] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.372845] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.392235] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.392729] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.392729] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.392938] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-733" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.393291] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-fd274843-22d2-4393-9ea8-b08f21e6f4d6 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.393779] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.393779] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.394559] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.394753] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd274843-22d2-4393-9ea8-b08f21e6f4d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.550363] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 749.552614] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a deletion is rescheduled due to dependency. [ 749.552614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.589363] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b20098c3-4944-4612-af2a-f2d01874388d in Status: SUCCESS [ 749.589599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.696468] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.696468] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.696468] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7e2ea97-1d4c-4f01-ab44-d5235784a05d with status ACTIVE [ 749.696468] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.696468] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.696468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.697301] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.697301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.697301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.697301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.697301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.698480] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7e2ea97-1d4c-4f01-ab44-d5235784a05d is going to be updated. [ 749.745409] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.745409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.745409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.745409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.745409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.745409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7e2ea97-1d4c-4f01-ab44-d5235784a05d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.898836] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.898836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.898836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.898836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.898836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.898836] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port fd274843-22d2-4393-9ea8-b08f21e6f4d6 not found, creating... [ 749.899255] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.899255] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.899406] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.901163] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.901163] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.901163] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.903905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.903905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.903905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.903905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.903905] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 is going to be created. [ 749.937888] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.938197] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.938369] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.939522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.942393] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.943893] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.200233] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.706353] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.706651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.708208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.708208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.708325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.708941] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be created. [ 750.731811] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.731982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.732149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.732314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.732498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.742550] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: UNINITIALIZED for 2s [ 750.790190] env[70032]: INFO networking_nsxv3.common.synchronization [req-18c6dc50-463f-420b-9338-21df303106ca req-ffe8ad18-a16e-4686-9512-a8ed77ec67c9 service nova] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 750.790393] env[70032]: INFO networking_nsxv3.common.synchronization [req-18c6dc50-463f-420b-9338-21df303106ca req-ffe8ad18-a16e-4686-9512-a8ed77ec67c9 service nova] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 750.790542] env[70032]: INFO networking_nsxv3.common.synchronization [req-18c6dc50-463f-420b-9338-21df303106ca req-ffe8ad18-a16e-4686-9512-a8ed77ec67c9 service nova] Enqueued Resource ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 with Priority: HIGHEST for action port [ 750.790751] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 750.790872] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 750.790967] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 with Priority: HIGHEST for action port [ 750.791697] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.791834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.791834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.796200] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.796200] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.796200] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.796200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.796200] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.796720] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd274843-22d2-4393-9ea8-b08f21e6f4d6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.796720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.796720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.796720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.797101] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd274843-22d2-4393-9ea8-b08f21e6f4d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.836266] env[70032]: INFO networking_nsxv3.common.synchronization [None req-a0f28b82-92d3-46d6-bd45-fe90418ef738 None None] Enqueued Resource ID: f5cff334-c46f-47aa-99e6-6c0b372511f9 with Priority: HIGHEST for action port [ 750.836758] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5cff334-c46f-47aa-99e6-6c0b372511f9 with Priority: HIGHEST for action port [ 750.837293] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5cff334-c46f-47aa-99e6-6c0b372511f9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.837535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5cff334-c46f-47aa-99e6-6c0b372511f9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.837535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5cff334-c46f-47aa-99e6-6c0b372511f9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.837727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5cff334-c46f-47aa-99e6-6c0b372511f9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.837806] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5cff334-c46f-47aa-99e6-6c0b372511f9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.298639] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.299728] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.299836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.300020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd274843-22d2-4393-9ea8-b08f21e6f4d6 with status ACTIVE [ 751.300192] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.300289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.300352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.300560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.300641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.300805] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.300894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.300952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.301128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.301199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.301373] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.301460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.301518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.301652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.301721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.301816] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 is going to be updated. [ 751.324354] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.324446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.324509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.324692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.324826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.324985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.341278] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5cff334-c46f-47aa-99e6-6c0b372511f9 [ 751.341519] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.341607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.341660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.341871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.342118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.343135] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5cff334-c46f-47aa-99e6-6c0b372511f9 already deleted. [ 751.343286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5cff334-c46f-47aa-99e6-6c0b372511f9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.804973] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.110805] env[70032]: INFO networking_nsxv3.common.synchronization [None req-98699302-42cb-462a-8100-f61c6d4ab409 None None] Enqueued Resource ID: 9e8855e3-a8d7-4cc4-a308-d4d4e1d07772 with Priority: HIGHEST for action port [ 752.110805] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e8855e3-a8d7-4cc4-a308-d4d4e1d07772 with Priority: HIGHEST for action port [ 752.111798] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e8855e3-a8d7-4cc4-a308-d4d4e1d07772 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.112097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e8855e3-a8d7-4cc4-a308-d4d4e1d07772" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.113066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e8855e3-a8d7-4cc4-a308-d4d4e1d07772" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.113624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e8855e3-a8d7-4cc4-a308-d4d4e1d07772" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.114200] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e8855e3-a8d7-4cc4-a308-d4d4e1d07772',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.162999] env[70032]: INFO networking_nsxv3.common.synchronization [req-207da1b4-eb25-4d1c-8b9f-0a3279c93300 req-5720c624-3ef9-4f34-9bbc-5c2966c3a209 tempest-ServerAddressesTestJSON-364535507 tempest-ServerAddressesTestJSON-364535507-project-member] Enqueued Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_members [ 752.164596] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGHEST for action security_group_members [ 752.164596] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.164596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.164596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.164596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.164596] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.164596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.164596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.164935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.164935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.164935] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.308720] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.308865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.308865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.309279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.309279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.309416] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be created. [ 752.334359] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.334359] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.334359] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.334588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.334749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.346187] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: UNINITIALIZED for 2s [ 752.545904] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b623f77a-8d8a-4559-8029-9b461f3e7081 tempest-VolumesAssistedSnapshotsTest-1282546720 tempest-VolumesAssistedSnapshotsTest-1282546720-project-member] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_rules [ 752.546538] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_rules [ 752.546894] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.548481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.548619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.548915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.549065] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.617455] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e8855e3-a8d7-4cc4-a308-d4d4e1d07772 [ 752.618590] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.618590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.618590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.618590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.618590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.618590] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e8855e3-a8d7-4cc4-a308-d4d4e1d07772 already deleted. [ 752.618590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e8855e3-a8d7-4cc4-a308-d4d4e1d07772" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.672561] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.672723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.672798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.673025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.673126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.673321] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.673423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.673488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.673641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.673719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.673808] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c252e10b-b1d9-4f18-a7ed-801f82010adb is going to be updated. [ 752.704047] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.704198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.704300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.704506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.704644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.711931] env[70032]: INFO networking_nsxv3.common.synchronization [None req-9f2a014a-1956-465a-9dd0-e9742fa4a276 tempest-VolumesAssistedSnapshotsTest-1282546720 tempest-VolumesAssistedSnapshotsTest-1282546720-project-member] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_rules [ 752.712450] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_rules [ 752.715194] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c252e10b-b1d9-4f18-a7ed-801f82010adb in Status: IN_PROGRESS for 2s [ 752.715436] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.715541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.752202] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 752.753310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.753310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.753310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.753310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.753639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.753639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.753844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.753844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.753978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.755550] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.068310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.068641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.068641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.069126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.069265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.069395] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f already deleted. [ 753.069516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.069701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.069897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.070017] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.258539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.258708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.258846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.259428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.259428] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.259428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.259609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.259746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.259880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.260022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.260282] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.260337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.260371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.260668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.260731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.260796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.260859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.261334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.261491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.261647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.261822] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.590009] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.590315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.590315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.590795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.590939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.591063] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f already deleted. [ 753.591155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.764979] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae: rpc.has_security_group_logging(os_id): False [ 753.781916] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.782083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.782228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.782475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.782630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.782793] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.782895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.782960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.783136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.783220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.783410] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.783505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.783568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.783715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.783783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.783963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.786746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.786872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.787051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.787145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.787245] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be created. [ 753.846355] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.846513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.846592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.846823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.847018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.860106] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 754.356485] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 754.356485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.356485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.356485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.356946] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.360708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.360708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.360708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.360708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.360708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.360708] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.494057] env[70032]: INFO networking_nsxv3.common.synchronization [None req-59187149-eb1c-4b5a-9f72-f1acaa01356e None None] Enqueued Resource ID: d1462779-bfd0-40fd-af48-1fc4de657e18 with Priority: HIGHEST for action port [ 754.494577] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1462779-bfd0-40fd-af48-1fc4de657e18 with Priority: HIGHEST for action port [ 754.494872] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1462779-bfd0-40fd-af48-1fc4de657e18 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.495039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1462779-bfd0-40fd-af48-1fc4de657e18" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.495076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1462779-bfd0-40fd-af48-1fc4de657e18" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.495756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1462779-bfd0-40fd-af48-1fc4de657e18" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.495842] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1462779-bfd0-40fd-af48-1fc4de657e18',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.727034] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c252e10b-b1d9-4f18-a7ed-801f82010adb in Status: SUCCESS [ 754.727590] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c252e10b-b1d9-4f18-a7ed-801f82010adb deletion is rescheduled due to dependency. [ 754.727590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.786734] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b1d5ef78-8c3f-4771-87cc-30de728589d8 tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_rules [ 754.787674] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_rules [ 754.788142] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.791382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.791517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.792404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.792404] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.863627] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.977135] env[70032]: INFO networking_nsxv3.common.synchronization [None req-476acd6f-f68b-4e9f-8f70-bb28143cc2f3 tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_rules [ 754.977740] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_rules [ 754.978527] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.978894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.998774] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1462779-bfd0-40fd-af48-1fc4de657e18 [ 754.999111] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.999282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.999357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.999575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.999672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.999771] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1462779-bfd0-40fd-af48-1fc4de657e18 already deleted. [ 754.999854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1462779-bfd0-40fd-af48-1fc4de657e18" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.312101] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.312557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.312557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.312557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.312557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.312725] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 already deleted. [ 755.312725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.313300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.313818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.313818] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.370026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af6e748-3c4e-4f35-8470-0d9bbc423daa: rpc.has_security_group_logging(os_id): False [ 755.383968] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.384200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.384321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.384784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.384897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.385189] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.385289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.385388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.385589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.385741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.385855] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be created. [ 755.441026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.445226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.445226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.445226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.445226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.453828] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 755.834508] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.834508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.834694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.834917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.834992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.835143] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 already deleted. [ 755.835231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.875725] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 755.876382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.237022] env[70032]: INFO networking_nsxv3.common.synchronization [req-8ff8a216-ec0c-431b-bab2-b023e4f86878 req-a4f2d503-5719-4932-afdb-556ef35c5158 tempest-AttachInterfacesV270Test-579139546 tempest-AttachInterfacesV270Test-579139546-project-member] Enqueued Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_members [ 757.237022] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGHEST for action security_group_members [ 757.237022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.237022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.237022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.237022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.237022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.237022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.237022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.237022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.237022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.237022] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.466937] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 757.467311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.739200] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.739200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.741815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.741815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.741815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.741815] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.741815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.741815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.741815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.741815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.741815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 465b2315-38b5-4037-b159-5d8565fe0f2f is going to be updated. [ 757.773168] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.773168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.773168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.773168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.773168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.779529] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 465b2315-38b5-4037-b159-5d8565fe0f2f in Status: IN_PROGRESS for 2s [ 759.596077] env[70032]: INFO networking_nsxv3.common.synchronization [None req-653c6177-d18a-4483-aeef-831ad7544390 None None] Enqueued Resource ID: efe53c06-0dee-4cce-92b7-d06db838ceff with Priority: HIGHEST for action port [ 759.596077] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe53c06-0dee-4cce-92b7-d06db838ceff with Priority: HIGHEST for action port [ 759.596612] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-efe53c06-0dee-4cce-92b7-d06db838ceff taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.596612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efe53c06-0dee-4cce-92b7-d06db838ceff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.596612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efe53c06-0dee-4cce-92b7-d06db838ceff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.596835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efe53c06-0dee-4cce-92b7-d06db838ceff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.596942] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efe53c06-0dee-4cce-92b7-d06db838ceff',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.791887] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 465b2315-38b5-4037-b159-5d8565fe0f2f in Status: SUCCESS [ 759.792083] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 465b2315-38b5-4037-b159-5d8565fe0f2f deletion is rescheduled due to dependency. [ 759.792202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.104023] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efe53c06-0dee-4cce-92b7-d06db838ceff [ 760.104023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.104023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.104023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.104023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.104023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.104023] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efe53c06-0dee-4cce-92b7-d06db838ceff already deleted. [ 760.104023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efe53c06-0dee-4cce-92b7-d06db838ceff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.093918] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-9287af38-12df-4f4a-9eba-15d3023fe258 tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 762.093918] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 762.093918] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.093918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.095453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.095453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.095453] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.095453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.095453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.095453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.095453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.095726] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.320837] env[70032]: INFO networking_nsxv3.common.synchronization [None req-5a3fbdaf-63ed-4f28-be09-91d2a6db3c92 None None] Enqueued Resource ID: 4c7f3526-fca0-49af-a0ac-44e940927e35 with Priority: HIGHEST for action port [ 762.320837] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7f3526-fca0-49af-a0ac-44e940927e35 with Priority: HIGHEST for action port [ 762.321211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7f3526-fca0-49af-a0ac-44e940927e35 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.321347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7f3526-fca0-49af-a0ac-44e940927e35" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.321389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7f3526-fca0-49af-a0ac-44e940927e35" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.321637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7f3526-fca0-49af-a0ac-44e940927e35" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.321733] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7f3526-fca0-49af-a0ac-44e940927e35',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.599671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.599671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.599671] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 already deleted. [ 762.599671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.827581] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c7f3526-fca0-49af-a0ac-44e940927e35 [ 762.827827] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.828122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.828122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.828301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.828482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.828597] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c7f3526-fca0-49af-a0ac-44e940927e35 already deleted. [ 762.828704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7f3526-fca0-49af-a0ac-44e940927e35" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.885543] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.885880] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.885880] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.886247] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.886518] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.886684] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.886828] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.887790] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.887790] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.887790] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.887790] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.887951] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.888028] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.888884] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.889073] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.889219] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.909387] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.909580] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.909727] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.909933] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.910314] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.910528] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.911236] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.911236] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.911236] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.413788] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.414564] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.414812] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.415192] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.420247] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.420247] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 not found, creating... [ 763.420247] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.420247] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.420247] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.420247] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.420714] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.421217] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.421634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.421861] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.422193] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.422814] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.423089] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 is going to be created. [ 763.444122] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.444366] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.444518] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.445621] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.445621] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.445621] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.186940] env[70032]: INFO networking_nsxv3.common.synchronization [None req-32cc5308-37a2-424b-80c8-4b9707c44522 None None] Enqueued Resource ID: f9cc13f7-d807-4989-b782-f9ad2b696a88 with Priority: HIGHEST for action port [ 764.186940] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9cc13f7-d807-4989-b782-f9ad2b696a88 with Priority: HIGHEST for action port [ 764.187128] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9cc13f7-d807-4989-b782-f9ad2b696a88 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.187279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9cc13f7-d807-4989-b782-f9ad2b696a88" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.187279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9cc13f7-d807-4989-b782-f9ad2b696a88" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.187613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9cc13f7-d807-4989-b782-f9ad2b696a88" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.187661] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9cc13f7-d807-4989-b782-f9ad2b696a88',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.316933] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-cfff2a71-1a1a-4422-856b-1f3b2a9cbdb7 service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 764.317198] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-cfff2a71-1a1a-4422-856b-1f3b2a9cbdb7 service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 764.317374] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-cfff2a71-1a1a-4422-856b-1f3b2a9cbdb7 service nova] Enqueued Resource ID: d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 with Priority: HIGHEST for action port [ 764.318138] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 764.318283] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 764.318380] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 with Priority: HIGHEST for action port [ 764.318658] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.318797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.318902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.319155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.319239] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.320139] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.320255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.320321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.320504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.321076] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.321197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.321262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.321415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.321499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.321590] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.323487] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.323583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.323651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.324509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.324509] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.691063] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9cc13f7-d807-4989-b782-f9ad2b696a88 [ 764.691063] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.691063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.691063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.691063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.691063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.691063] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9cc13f7-d807-4989-b782-f9ad2b696a88 already deleted. [ 764.691063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9cc13f7-d807-4989-b782-f9ad2b696a88" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.826026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.830023] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.830023] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 with status ACTIVE [ 764.830023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.830023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.830023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.830023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.830745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.830745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.830745] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69 is going to be updated. [ 764.851158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.851532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.853579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.853579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.853579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.853579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7fb7868-9d6f-4e4e-ace0-e9f9ea7c8f69" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.332922] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.841472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.841472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.841472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.841472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.841472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.841472] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be created. [ 765.864771] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.864771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.864771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.864771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.864771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.872059] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: UNINITIALIZED for 2s [ 767.161342] env[70032]: INFO networking_nsxv3.common.synchronization [None req-2417bbe4-5f2e-429a-bd7c-289a3067467c None None] Enqueued Resource ID: 2bd52364-3258-4ac2-a44b-02f16f9cbdb2 with Priority: HIGHEST for action port [ 767.161680] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bd52364-3258-4ac2-a44b-02f16f9cbdb2 with Priority: HIGHEST for action port [ 767.165043] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bd52364-3258-4ac2-a44b-02f16f9cbdb2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.165043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bd52364-3258-4ac2-a44b-02f16f9cbdb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.165043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bd52364-3258-4ac2-a44b-02f16f9cbdb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.165043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bd52364-3258-4ac2-a44b-02f16f9cbdb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.165043] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd52364-3258-4ac2-a44b-02f16f9cbdb2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.214946] env[70032]: INFO networking_nsxv3.common.synchronization [None req-113fbc6e-21a7-4f6f-902c-f2b7c019d1f8 None None] Enqueued Resource ID: 4a524eb8-fe18-4527-88d0-f41cf73fa961 with Priority: HIGHEST for action port [ 767.215757] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a524eb8-fe18-4527-88d0-f41cf73fa961 with Priority: HIGHEST for action port [ 767.215833] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a524eb8-fe18-4527-88d0-f41cf73fa961 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.216822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a524eb8-fe18-4527-88d0-f41cf73fa961" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.216822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a524eb8-fe18-4527-88d0-f41cf73fa961" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.216822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a524eb8-fe18-4527-88d0-f41cf73fa961" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.216822] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a524eb8-fe18-4527-88d0-f41cf73fa961',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.665648] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bd52364-3258-4ac2-a44b-02f16f9cbdb2 [ 767.667659] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.668178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.668178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.668178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.668311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.668337] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bd52364-3258-4ac2-a44b-02f16f9cbdb2 already deleted. [ 767.668414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bd52364-3258-4ac2-a44b-02f16f9cbdb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.718919] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a524eb8-fe18-4527-88d0-f41cf73fa961 [ 767.719396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.719565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.719638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.719933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.719933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.721690] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a524eb8-fe18-4527-88d0-f41cf73fa961 already deleted. [ 767.721690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a524eb8-fe18-4527-88d0-f41cf73fa961" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.887196] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.887196] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.887196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.887196] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.389879] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.390178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.390178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.390449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.390614] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.390662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.390696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.390874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.390921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.391018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.391171] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.391264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.391326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.391511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.392076] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.392076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.392076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.392076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.392076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.392311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.392311] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.894934] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42d4b17b-1bab-41c3-94ca-ac72b8e35f54: rpc.has_security_group_logging(os_id): False [ 768.912364] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.912582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.912688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.912978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.913133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.913371] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.913539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.913656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.913881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.914022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.914762] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.915104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.915104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.915267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.915363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.915634] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.915763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.915850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.916052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.916364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.916470] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be created. [ 768.969698] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.969835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.969940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.970175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.970380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.981615] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 769.407743] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1143ca8b-de2f-458f-817f-4eb50e5a1ffa None None] Enqueued Resource ID: 6962d424-070a-4d09-820f-899d949c5f52 with Priority: HIGHEST for action port [ 769.408630] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6962d424-070a-4d09-820f-899d949c5f52 with Priority: HIGHEST for action port [ 769.408809] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6962d424-070a-4d09-820f-899d949c5f52 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.408809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6962d424-070a-4d09-820f-899d949c5f52" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.409010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6962d424-070a-4d09-820f-899d949c5f52" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.409192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6962d424-070a-4d09-820f-899d949c5f52" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.409282] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6962d424-070a-4d09-820f-899d949c5f52',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.914648] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6962d424-070a-4d09-820f-899d949c5f52 [ 769.914648] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.914648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.914648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.914648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.914648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.914648] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6962d424-070a-4d09-820f-899d949c5f52 already deleted. [ 769.915092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6962d424-070a-4d09-820f-899d949c5f52" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.241543] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-71b7b19b-d3e3-495a-b9d0-7b57fda5205d tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 770.242092] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 770.242391] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.242888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.242958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.243941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.244115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.244221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.244283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.244463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.244555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.244650] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.281113] env[70032]: INFO networking_nsxv3.common.synchronization [None req-afeb9c00-f54f-491d-b787-50f1c99b3c0e None None] Enqueued Resource ID: 96275715-1916-4726-bc83-c6b2a1430259 with Priority: HIGHEST for action port [ 770.282339] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96275715-1916-4726-bc83-c6b2a1430259 with Priority: HIGHEST for action port [ 770.286022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-96275715-1916-4726-bc83-c6b2a1430259 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.286022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96275715-1916-4726-bc83-c6b2a1430259" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.286022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96275715-1916-4726-bc83-c6b2a1430259" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.286022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96275715-1916-4726-bc83-c6b2a1430259" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.286022] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96275715-1916-4726-bc83-c6b2a1430259',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.747756] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.786048] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96275715-1916-4726-bc83-c6b2a1430259 [ 770.786270] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.786402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.786471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.786806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.786952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.787071] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96275715-1916-4726-bc83-c6b2a1430259 already deleted. [ 770.787157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96275715-1916-4726-bc83-c6b2a1430259" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.885496] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.885708] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.885836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.886512] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.886809] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.886985] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.890946] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.890946] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.891081] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.891258] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.891379] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.891494] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.891606] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.891720] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.891829] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.891984] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.909884] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.910070] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.910208] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.910383] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.910697] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7eb9e38d-b626-4bee-86dd-807253625748 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.910860] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.910975] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.911328] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.911488] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eb9e38d-b626-4bee-86dd-807253625748',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.994253] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 770.995212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.253905] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.415020] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.415020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.415020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.415020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.415020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.415020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7eb9e38d-b626-4bee-86dd-807253625748 not found, creating... [ 771.415308] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.415308] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.415514] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.415706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.415847] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.416227] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.416392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.416520] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.416755] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.416902] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.417072] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7eb9e38d-b626-4bee-86dd-807253625748 is going to be created. [ 771.439802] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.439802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.439802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.439802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.439802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.439802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.588662] env[70032]: INFO networking_nsxv3.common.synchronization [None req-cabdbfac-114b-48d4-97e3-a833942f522c tempest-VolumesAdminNegativeTest-1559699096 tempest-VolumesAdminNegativeTest-1559699096-project-member] Enqueued Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_rules [ 771.589369] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_rules [ 771.589761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b9cad3-7556-42c3-8caf-441973387e39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.589897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.589965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.590237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.590318] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.746740] env[70032]: INFO networking_nsxv3.common.synchronization [None req-dc66e353-4bcf-42af-b8e5-619949bd5ad1 tempest-VolumesAdminNegativeTest-1559699096 tempest-VolumesAdminNegativeTest-1559699096-project-member] Enqueued Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_rules [ 771.746740] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_rules [ 771.746991] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b9cad3-7556-42c3-8caf-441973387e39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.747117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.757146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.757146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.757146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.757146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.757603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.757603] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 771.786538] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.786681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.786816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.787067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.787210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.799031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 771.878843] env[70032]: INFO networking_nsxv3.common.synchronization [req-99ca7040-135f-4471-aa07-4457c9ca6b64 req-3fd60d57-ac59-45f8-9441-7945415be663 tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 771.880233] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 771.880233] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.880233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.880233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.880444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.880585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.881173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.881173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.881173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.881173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.881173] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.112223] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.112223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.112223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.112223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.112223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.112223] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b9cad3-7556-42c3-8caf-441973387e39 already deleted. [ 772.112223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.112223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.112223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.112223] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.208150] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f2ebe989-7ed9-4abc-9a8f-c35a2a8a17bb None None] Enqueued Resource ID: 5b866bbc-a1d2-4c18-8dd5-17baf520a240 with Priority: HIGHEST for action port [ 772.208813] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b866bbc-a1d2-4c18-8dd5-17baf520a240 with Priority: HIGHEST for action port [ 772.209137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b866bbc-a1d2-4c18-8dd5-17baf520a240 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.209368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b866bbc-a1d2-4c18-8dd5-17baf520a240" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.209368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b866bbc-a1d2-4c18-8dd5-17baf520a240" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.209587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b866bbc-a1d2-4c18-8dd5-17baf520a240" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.209671] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b866bbc-a1d2-4c18-8dd5-17baf520a240',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.345683] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-2778a0bc-01fe-44c1-8003-897f3367d89a service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 772.345683] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-2778a0bc-01fe-44c1-8003-897f3367d89a service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 772.345683] env[70032]: INFO networking_nsxv3.common.synchronization [req-bf6e4aee-e702-4b70-82ce-8db8b4e568c4 req-2778a0bc-01fe-44c1-8003-897f3367d89a service nova] Enqueued Resource ID: 7eb9e38d-b626-4bee-86dd-807253625748 with Priority: HIGHEST for action port [ 772.346165] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 772.346290] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 772.346384] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eb9e38d-b626-4bee-86dd-807253625748 with Priority: HIGHEST for action port [ 772.346673] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.346774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.346831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.351062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.351203] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.352163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.352258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.352460] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eb9e38d-b626-4bee-86dd-807253625748 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.353518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.353518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.353518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.353518] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eb9e38d-b626-4bee-86dd-807253625748',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.383695] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.385389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.385389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.385389] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be updated. [ 772.412217] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.412348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.412423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.412669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.412810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.421861] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 772.635188] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.635306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.635341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.635647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.635841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.636117] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b9cad3-7556-42c3-8caf-441973387e39 already deleted. [ 772.636117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.712371] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b866bbc-a1d2-4c18-8dd5-17baf520a240 [ 772.712371] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.713241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.713241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.713241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.713241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.713241] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b866bbc-a1d2-4c18-8dd5-17baf520a240 already deleted. [ 772.713241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b866bbc-a1d2-4c18-8dd5-17baf520a240" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.855783] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.856126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.856126] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7eb9e38d-b626-4bee-86dd-807253625748 with status ACTIVE [ 772.856981] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.856981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.856981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.856981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.856981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.857279] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.857703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.857703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.857703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.857814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.858394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.858394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.858394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.858394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.858580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.858580] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7eb9e38d-b626-4bee-86dd-807253625748 is going to be updated. [ 772.883017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.883017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.883017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.883017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.883017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.883017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eb9e38d-b626-4bee-86dd-807253625748" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.808715] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 773.808946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.809180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.809405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.809598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.809763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.809935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.810063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.810095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.810183] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.314295] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.433852] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 774.433852] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae deletion is rescheduled due to dependency. [ 774.434093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.817661] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.144997] env[70032]: INFO networking_nsxv3.common.synchronization [req-5c2b6071-4095-48d8-bb6e-a84af03f2918 req-3030468b-6393-4664-8e77-a1ab3814a232 tempest-DeleteServersAdminTestJSON-623582194 tempest-DeleteServersAdminTestJSON-623582194-project-member] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 775.145620] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 775.145988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.146090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.146254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.146418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.146539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.146639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.146702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.146877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.146970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.147095] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.321767] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.324325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.324325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.324325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.324325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.324325] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 775.354435] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.354435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.354435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.354435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.354435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.362277] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 775.539111] env[70032]: INFO networking_nsxv3.common.synchronization [None req-96ccb153-75a6-40e3-9ca9-75500ef84ba3 None None] Enqueued Resource ID: 0eab5530-47aa-4029-bc2e-cecc669c3fa5 with Priority: HIGHEST for action port [ 775.539397] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eab5530-47aa-4029-bc2e-cecc669c3fa5 with Priority: HIGHEST for action port [ 775.540014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eab5530-47aa-4029-bc2e-cecc669c3fa5 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.540188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eab5530-47aa-4029-bc2e-cecc669c3fa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.540252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eab5530-47aa-4029-bc2e-cecc669c3fa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.540485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eab5530-47aa-4029-bc2e-cecc669c3fa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.540568] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eab5530-47aa-4029-bc2e-cecc669c3fa5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.580662] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.580662] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.580807] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.580973] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.581680] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.582849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.582849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.582849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.582849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.582849] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.583089] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.583089] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.583205] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.585339] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.585339] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.585339] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.605203] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.605203] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.605203] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.605203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.605203] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-803b05f1-8d5f-4c89-baa6-91c37a29431a taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.605203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.605203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.605203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.605203] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('803b05f1-8d5f-4c89-baa6-91c37a29431a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.652321] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.652321] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.652321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.652321] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 is going to be updated. [ 775.673648] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.673788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.673858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.674085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.674228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.682883] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: IN_PROGRESS for 2s [ 776.043393] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eab5530-47aa-4029-bc2e-cecc669c3fa5 [ 776.043609] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.043759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.043827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.044094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.044188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.044307] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eab5530-47aa-4029-bc2e-cecc669c3fa5 already deleted. [ 776.044380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eab5530-47aa-4029-bc2e-cecc669c3fa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.109760] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.111020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.111020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.111020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.111020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.111020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 803b05f1-8d5f-4c89-baa6-91c37a29431a not found, creating... [ 776.111382] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.115059] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.115059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.115059] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 803b05f1-8d5f-4c89-baa6-91c37a29431a is going to be created. [ 776.135025] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.136637] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.136832] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.137162] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.137401] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.137649] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.980698] env[70032]: INFO networking_nsxv3.common.synchronization [req-5c2b6071-4095-48d8-bb6e-a84af03f2918 req-9c1139bb-8699-4afc-85a4-e87c23340f86 service nova] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_rules [ 776.980961] env[70032]: INFO networking_nsxv3.common.synchronization [req-5c2b6071-4095-48d8-bb6e-a84af03f2918 req-9c1139bb-8699-4afc-85a4-e87c23340f86 service nova] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 776.981047] env[70032]: INFO networking_nsxv3.common.synchronization [req-5c2b6071-4095-48d8-bb6e-a84af03f2918 req-9c1139bb-8699-4afc-85a4-e87c23340f86 service nova] Enqueued Resource ID: 803b05f1-8d5f-4c89-baa6-91c37a29431a with Priority: HIGHEST for action port [ 776.981306] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_rules [ 776.981435] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 776.981545] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803b05f1-8d5f-4c89-baa6-91c37a29431a with Priority: HIGHEST for action port [ 776.982613] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.982714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.982790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.983047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.983142] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.984642] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.984845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.985907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-803b05f1-8d5f-4c89-baa6-91c37a29431a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.986206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.986585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.986793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.986882] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('803b05f1-8d5f-4c89-baa6-91c37a29431a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.372646] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 777.372857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.373312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.373671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.374127] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.374248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.374313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.374494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.374619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.374723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.375058] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.485254] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.485254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.489947] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 803b05f1-8d5f-4c89-baa6-91c37a29431a with status ACTIVE [ 777.490180] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.490369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.490436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.490636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.490740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.490932] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.491048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.491111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.491279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.491369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.491576] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.491661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.491710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.491849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.491920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.492014] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 803b05f1-8d5f-4c89-baa6-91c37a29431a is going to be updated. [ 777.505247] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c7856923-7ffa-402a-8e12-65c9407d30b1 None None] Enqueued Resource ID: d41e5b94-f963-401a-bbc3-3f88a1c9aaa6 with Priority: HIGHEST for action port [ 777.505540] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41e5b94-f963-401a-bbc3-3f88a1c9aaa6 with Priority: HIGHEST for action port [ 777.506220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d41e5b94-f963-401a-bbc3-3f88a1c9aaa6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.506690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d41e5b94-f963-401a-bbc3-3f88a1c9aaa6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.506690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d41e5b94-f963-401a-bbc3-3f88a1c9aaa6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.506793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d41e5b94-f963-401a-bbc3-3f88a1c9aaa6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.506903] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41e5b94-f963-401a-bbc3-3f88a1c9aaa6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.514764] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.514764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.514764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.514764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.514764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.514764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-803b05f1-8d5f-4c89-baa6-91c37a29431a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.693585] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: SUCCESS [ 777.693917] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 deletion is rescheduled due to dependency. [ 777.694115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.694350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.694680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.694932] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.695099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.695228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.695444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.695630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.695747] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.877939] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.877939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.877939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.877939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.877939] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.878209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.878209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.878265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.881017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.881017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.881017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.881017] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.013506] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d41e5b94-f963-401a-bbc3-3f88a1c9aaa6 [ 778.014603] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.014603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.014603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.014603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.014603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.014603] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d41e5b94-f963-401a-bbc3-3f88a1c9aaa6 already deleted. [ 778.014603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d41e5b94-f963-401a-bbc3-3f88a1c9aaa6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.198361] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.387425] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42d4b17b-1bab-41c3-94ca-ac72b8e35f54: rpc.has_security_group_logging(os_id): False [ 778.405866] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.408021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.408021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.408021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.408662] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.408662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.408662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.408662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.408662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.408662] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 778.482530] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.483673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.483673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.483673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.483673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.504522] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 778.701526] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.203974] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.203974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.203974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.203974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.203974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.203974] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 is going to be updated. [ 779.233134] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.234155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.234155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.234155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.234155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.241867] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: IN_PROGRESS for 2s [ 780.517729] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 780.518019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.119208] env[70032]: INFO networking_nsxv3.common.synchronization [req-7b7ee090-c07b-4384-b71c-1684a322d774 req-668bf55c-6977-4288-ada6-df42e700a55a tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 781.120110] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 781.120797] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.121099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.121287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.121774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.122143] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.122417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.122753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.123103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.123275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.123478] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.251920] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: SUCCESS [ 781.252862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.253159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.253468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.253762] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.254037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.254150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.254363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.254481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.254649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.254755] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.580678] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-323 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.581030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-323" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.581030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-323" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.581539] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-323" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.581631] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.581876] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.582099] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.583781] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.584114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.584421] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.584607] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.584738] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.584853] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.585615] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.585847] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.586254] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.605843] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.606045] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 781.606262] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.606382] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-323" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.606724] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.606906] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.607053] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.607384] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.607527] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd667efd-e2ca-45d6-b9c0-19f93cfb551c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.626736] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.626927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.627015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.627244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.627339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.627545] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.627679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.627730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.627895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.627977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.628082] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef already deleted. [ 781.628169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.757571] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.757723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.757794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.758100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.758274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.758380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.758447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.758625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.758726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.758825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.758976] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.759086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.759154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.759301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.759438] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.759532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.759606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.759762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.759837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.759921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.760047] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.110039] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.110292] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.110422] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.110709] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.110914] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.111043] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port fd667efd-e2ca-45d6-b9c0-19f93cfb551c not found, creating... [ 782.111311] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.111471] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.111590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.111842] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.111955] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.112257] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.112417] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.112568] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.112826] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.112911] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.114115] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c is going to be created. [ 782.133768] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.133984] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.134132] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.134852] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.135097] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.135337] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.264171] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5000c8de-0235-4e38-93be-83111bb42b93: rpc.has_security_group_logging(os_id): False [ 782.281625] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.281844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.281950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.282235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.282339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.282600] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.282695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.282754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.282882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.282962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.283302] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.283403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.283517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.283813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.283813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.284088] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.284605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.284605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.284605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.284605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.284605] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 is going to be updated. [ 782.358604] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.358753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.358837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.359387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.359578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.374021] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: IN_PROGRESS for 2s [ 782.485498] env[70032]: INFO networking_nsxv3.common.synchronization [req-e14c4c44-c8cb-4a69-a5c7-25ba68697bc3 req-7807bceb-bc56-4405-bea2-4c022823c6db tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 782.489155] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 782.489155] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.489155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.489155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.489155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.490045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.490186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.490255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.490443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.490557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.490636] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.494760] env[70032]: INFO networking_nsxv3.common.synchronization [req-6e94f68b-9ff5-412c-b63e-e7aa56dc6578 req-4960fca0-b092-44a4-a320-385faf197324 tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 782.494996] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 782.495547] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.495655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.915934] env[70032]: INFO networking_nsxv3.common.synchronization [req-7b7ee090-c07b-4384-b71c-1684a322d774 req-1cc03de6-ce11-4021-8be8-66b911f7a012 service nova] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_rules [ 782.916355] env[70032]: INFO networking_nsxv3.common.synchronization [req-7b7ee090-c07b-4384-b71c-1684a322d774 req-1cc03de6-ce11-4021-8be8-66b911f7a012 service nova] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 782.916640] env[70032]: INFO networking_nsxv3.common.synchronization [req-7b7ee090-c07b-4384-b71c-1684a322d774 req-1cc03de6-ce11-4021-8be8-66b911f7a012 service nova] Enqueued Resource ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c with Priority: HIGHEST for action port [ 782.917214] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_rules [ 782.917343] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 782.917462] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c with Priority: HIGHEST for action port [ 782.919190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.919406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.919511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.919834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.920529] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.921796] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.921946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.922027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.922226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.922514] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.922624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.922697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.922988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.923102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.924319] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.925196] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.925299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.925370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.925583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.925668] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd667efd-e2ca-45d6-b9c0-19f93cfb551c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.993151] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.994232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.994374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.994664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.994811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.997276] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.997467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.997591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.997954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.998161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.998303] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 783.030031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.030031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.030031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.030031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.030031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.040238] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 783.427959] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.428135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.428305] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.429262] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd667efd-e2ca-45d6-b9c0-19f93cfb551c with status ACTIVE [ 783.429451] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.429566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.429651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.429940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.430046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.430220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.430320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.430374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.430539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.430617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.430797] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.430892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.430951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.431114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.431189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.431271] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c is going to be updated. [ 783.453351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.453351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.453351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.453351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.453351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.453351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.910226] env[70032]: INFO networking_nsxv3.common.synchronization [req-fa65c6f3-3250-4d3f-9d0a-e32e17d097c5 req-69085c35-2ce0-44f2-b6ee-1381d126675a tempest-FloatingIPsAssociationTestJSON-445852628 tempest-FloatingIPsAssociationTestJSON-445852628-project-member] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 783.911318] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 783.911688] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.911846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.912046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.912122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.915499] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.915499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.915499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.915499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.915499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.915499] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.932930] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.390257] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: SUCCESS [ 784.390257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.415722] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.435442] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.435634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.435726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.435971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.436123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.436246] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be created. [ 784.467178] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.467337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.467433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.471024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.471024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.477742] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: UNINITIALIZED for 2s [ 784.737731] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.738486] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.738670] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.738988] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.739314] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.739519] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.739672] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.739927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.740128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.740375] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.740526] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.740675] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.741362] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.741362] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.741362] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.741362] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.760778] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.760778] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.760778] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.760930] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-996" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.761252] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.761447] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.761570] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.761922] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.762083] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00937ff-8ecd-43ff-8a5e-9a752731b1e1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.919587] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.057290] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 785.057572] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 deletion is rescheduled due to dependency. [ 785.057695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.057917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.058260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.058439] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.058568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.058685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.058879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.059016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.059281] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.264955] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.265199] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.265331] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.265640] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.265851] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.266077] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port b00937ff-8ecd-43ff-8a5e-9a752731b1e1 not found, creating... [ 785.266371] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.266578] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.266665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.266933] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.267136] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.267489] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.267698] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.267833] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.268110] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.268286] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.268440] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: b00937ff-8ecd-43ff-8a5e-9a752731b1e1 is going to be created. [ 785.287736] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.287939] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.288082] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.288358] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.288579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.288805] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.423024] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.423024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.423024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.423024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.423024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.423024] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be updated. [ 785.462161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.462161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.462161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.462161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.462351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.470853] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: IN_PROGRESS for 2s [ 785.564200] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.564200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.564200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.564200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.564200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.564472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.564472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.564472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.564634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.564673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.564753] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 785.588187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.588921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.588921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.588921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.588921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.596635] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 786.078048] env[70032]: INFO networking_nsxv3.common.synchronization [req-fa65c6f3-3250-4d3f-9d0a-e32e17d097c5 req-bb0cfa49-b121-48b0-a68f-04e615d06181 service nova] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_rules [ 786.078048] env[70032]: INFO networking_nsxv3.common.synchronization [req-fa65c6f3-3250-4d3f-9d0a-e32e17d097c5 req-bb0cfa49-b121-48b0-a68f-04e615d06181 service nova] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 786.078048] env[70032]: INFO networking_nsxv3.common.synchronization [req-fa65c6f3-3250-4d3f-9d0a-e32e17d097c5 req-bb0cfa49-b121-48b0-a68f-04e615d06181 service nova] Enqueued Resource ID: b00937ff-8ecd-43ff-8a5e-9a752731b1e1 with Priority: HIGHEST for action port [ 786.078048] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_rules [ 786.078048] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 786.078048] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00937ff-8ecd-43ff-8a5e-9a752731b1e1 with Priority: HIGHEST for action port [ 786.078048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.078048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.081073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.081530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.081831] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.082948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.085018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.085018] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.085018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.085018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.085018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.085018] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00937ff-8ecd-43ff-8a5e-9a752731b1e1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.487701] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 786.488428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.488428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.488428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.488760] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.488760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.488760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.488876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.488876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.488956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.489068] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.586014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.586183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.588042] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b00937ff-8ecd-43ff-8a5e-9a752731b1e1 with status ACTIVE [ 786.588042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.588042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.588042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.588042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.588306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.588306] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.588376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.588483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.588591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.588669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.588853] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.588944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.589040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.589189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.589441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.589441] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b00937ff-8ecd-43ff-8a5e-9a752731b1e1 is going to be updated. [ 786.615804] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.615963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.616150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.617033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.617033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.617033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b00937ff-8ecd-43ff-8a5e-9a752731b1e1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.991997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.991997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.991997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.992285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.992482] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.992617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.992712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.992912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.993077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.993225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.993394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.993523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.993593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.993744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.993886] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.993982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.994057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.994199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.994280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.994348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.994438] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.480580] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: SUCCESS [ 787.480906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.481088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.481361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.481608] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.481743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.481829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.482011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.482118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.482240] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.496959] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38545a1e-8581-4dfd-b549-14a8b50d98ef: rpc.has_security_group_logging(os_id): False [ 787.513832] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.513936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.514028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.514290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.514410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.514615] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.514723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.514825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.515049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.515133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.515338] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.515429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.515493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.515687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.515731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.515960] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.516150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.516150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.516311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.516388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.516473] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be created. [ 787.570671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.570820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.570912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.571171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.571353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.581963] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: IN_PROGRESS for 2s [ 787.614771] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 787.615091] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 deletion is rescheduled due to dependency. [ 787.615181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.985739] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.488024] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.840285] env[70032]: INFO networking_nsxv3.common.synchronization [req-f6057a1a-b1a0-4e6e-a4f6-14185ba425fe req-88bf6bfd-1b65-422f-ad8f-d4202e1a9f5f tempest-DeleteServersAdminTestJSON-623582194 tempest-DeleteServersAdminTestJSON-623582194-project-member] Enqueued Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 788.840285] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5000c8de-0235-4e38-93be-83111bb42b93 with Priority: HIGHEST for action security_group_members [ 788.840285] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-5000c8de-0235-4e38-93be-83111bb42b93 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.840285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.840285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.840487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.840930] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.840930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.840930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.840930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.841438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.841579] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5000c8de-0235-4e38-93be-83111bb42b93',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.989445] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.989663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.989817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.990080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.990683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.990683] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be updated. [ 789.019922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.020125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.020506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.020506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.021331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.029073] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: IN_PROGRESS for 2s [ 789.343766] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.344074] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.344074] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.344248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.344351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.344546] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.344719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.344780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.344932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.345044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.345115] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 is going to be updated. [ 789.371009] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.371169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.371290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.371447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.371720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.379815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: IN_PROGRESS for 2s [ 789.597679] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 789.597950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.038963] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: SUCCESS [ 791.039257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.039379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.039595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.039800] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.039916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.040154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.040324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.040421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.040511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.040603] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.392013] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5000c8de-0235-4e38-93be-83111bb42b93 in Status: SUCCESS [ 791.392220] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5000c8de-0235-4e38-93be-83111bb42b93 deletion is rescheduled due to dependency. [ 791.392330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5000c8de-0235-4e38-93be-83111bb42b93" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.543968] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.544219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.545096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.545349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.545567] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.545685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.545770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.545979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.546091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.546199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.546368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.546464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.546535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.546684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.546825] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.546944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.546992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.547158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.547236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.547319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.547406] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.051902] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8359b363-4508-4e0c-909f-bfb6605cb735: rpc.has_security_group_logging(os_id): False [ 792.070274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.070274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.070274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.070274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.070845] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.070845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.070845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.070845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.070845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.070845] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be updated. [ 792.135493] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.135493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.135493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.135493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.135493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.152599] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: IN_PROGRESS for 2s [ 792.485151] env[70032]: INFO networking_nsxv3.common.synchronization [req-3e61da04-b0c8-46de-83a2-54ff2aeeae80 req-a747fa4a-12ea-4798-9f9d-1cd0af5a98a7 tempest-ImagesOneServerTestJSON-283767551 tempest-ImagesOneServerTestJSON-283767551-project-member] Enqueued Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_members [ 792.485151] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGHEST for action security_group_members [ 792.485234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.485286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.485439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.485568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.486402] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.486551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.486611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.486758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.486851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.486958] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.989888] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.990136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.990216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.990417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.990511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.990978] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.990978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.990978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.991136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.991136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.991189] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c is going to be updated. [ 793.017159] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.018030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.018030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.018030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.018030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.025512] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c in Status: IN_PROGRESS for 2s [ 794.165875] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: SUCCESS [ 794.166178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.040802] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c in Status: SUCCESS [ 795.040998] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c deletion is rescheduled due to dependency. [ 795.041131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.115904] env[70032]: INFO networking_nsxv3.common.synchronization [req-1ef0b739-2b35-4c30-aaf7-ddd50d44eaad req-7cac9295-af96-449a-9b8c-10b10250da70 tempest-ServerGroupTestJSON-1373147721 tempest-ServerGroupTestJSON-1373147721-project-member] Enqueued Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_members [ 797.116542] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_members [ 797.116876] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.117062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.117168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.117443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.117620] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.117763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.117867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.118096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.118203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.118306] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.552108] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8c89a763-ef31-4524-ae92-74177b72f19f None None] Enqueued Resource ID: 09393232-88ca-4e16-9d85-ffd1489aa25f with Priority: HIGHEST for action port [ 797.552108] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09393232-88ca-4e16-9d85-ffd1489aa25f with Priority: HIGHEST for action port [ 797.552108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-09393232-88ca-4e16-9d85-ffd1489aa25f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.552108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09393232-88ca-4e16-9d85-ffd1489aa25f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.552108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09393232-88ca-4e16-9d85-ffd1489aa25f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.552108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09393232-88ca-4e16-9d85-ffd1489aa25f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.552108] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09393232-88ca-4e16-9d85-ffd1489aa25f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.624489] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.624489] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.624489] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 already deleted. [ 797.624489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.679326] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-140 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.679601] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-140" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.679776] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-140" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.680579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-140" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.680579] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.680744] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.681174] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.681458] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.681670] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.681979] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.682166] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.682394] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.682580] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.683128] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.683128] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.683231] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.703789] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.703789] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.703983] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.704119] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-140" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.704410] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.704582] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.704775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.705104] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.705245] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1aad3b5-fee5-45a3-bfdc-70afc3137e83',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.055166] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09393232-88ca-4e16-9d85-ffd1489aa25f [ 798.055367] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.055500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.055568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.055851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.055983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.056094] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09393232-88ca-4e16-9d85-ffd1489aa25f already deleted. [ 798.056175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09393232-88ca-4e16-9d85-ffd1489aa25f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.209926] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.209926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.209926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.209926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.209926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.209926] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port c1aad3b5-fee5-45a3-bfdc-70afc3137e83 not found, creating... [ 798.209926] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.209926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.209926] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.210443] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.210443] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.210443] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.210547] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.212267] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.212267] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.212267] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.212267] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: c1aad3b5-fee5-45a3-bfdc-70afc3137e83 is going to be created. [ 798.231673] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.232672] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.233704] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.233704] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.233704] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.233704] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.815016] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-d6fa9994-015c-465d-bb76-e62511955589 tempest-ListServersNegativeTestJSON-226060042 tempest-ListServersNegativeTestJSON-226060042-project-member] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 798.815563] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 798.815897] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.816033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.816105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.816365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.816501] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.816589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.816705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.817015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.817015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.817015] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.033568] env[70032]: INFO networking_nsxv3.common.synchronization [None req-311230c4-7fb3-444d-8958-f6bae80e97c3 tempest-ServersTestManualDisk-805921895 tempest-ServersTestManualDisk-805921895-project-member] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_rules [ 799.034092] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_rules [ 799.034404] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.034518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.034653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.034853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.034936] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.156508] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c1038df9-a2e9-441c-beeb-2a8d15f67627 tempest-ServersTestManualDisk-805921895 tempest-ServersTestManualDisk-805921895-project-member] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_rules [ 799.160106] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_rules [ 799.160455] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.160897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.320010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.320304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.320304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.320464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.320554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.320752] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.320853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.320916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.321100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.321168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.321239] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 already deleted. [ 799.321436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.412447] env[70032]: INFO networking_nsxv3.common.synchronization [req-1ef0b739-2b35-4c30-aaf7-ddd50d44eaad req-b46749ee-ffd9-4a13-b122-50e487988c10 service nova] Enqueued Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_rules [ 799.412636] env[70032]: INFO networking_nsxv3.common.synchronization [req-1ef0b739-2b35-4c30-aaf7-ddd50d44eaad req-b46749ee-ffd9-4a13-b122-50e487988c10 service nova] Enqueued Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_members [ 799.412773] env[70032]: INFO networking_nsxv3.common.synchronization [req-1ef0b739-2b35-4c30-aaf7-ddd50d44eaad req-b46749ee-ffd9-4a13-b122-50e487988c10 service nova] Enqueued Resource ID: c1aad3b5-fee5-45a3-bfdc-70afc3137e83 with Priority: HIGHEST for action port [ 799.412998] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_rules [ 799.413136] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_members [ 799.413233] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1aad3b5-fee5-45a3-bfdc-70afc3137e83 with Priority: HIGHEST for action port [ 799.413761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.413933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.413933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.418281] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.418281] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.418281] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.418281] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.418281] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.418281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.418281] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1aad3b5-fee5-45a3-bfdc-70afc3137e83',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.520775] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-959 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.520775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.520775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.520775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.520775] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.520775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.520775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.521440] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.521795] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.522148] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.522379] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.522600] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.522865] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.523116] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.523338] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.525316] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.543170] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.543348] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.543466] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.543661] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.543970] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-ef302599-f3e4-4e27-8dfb-431051e43b21 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.544198] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.544330] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.544636] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.545071] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef302599-f3e4-4e27-8dfb-431051e43b21',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.571423] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.571613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.571718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.571974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.572115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.572452] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 already deleted. [ 799.572555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.572760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.572990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.575969] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.833449] env[70032]: INFO networking_nsxv3.common.synchronization [None req-785e21cf-5258-44a5-beef-cc2ab17eac6e None None] Enqueued Resource ID: 70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff with Priority: HIGHEST for action port [ 799.833449] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff with Priority: HIGHEST for action port [ 799.836445] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.836445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.836445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.836445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.836445] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.924137] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.924137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.924137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.924137] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1aad3b5-fee5-45a3-bfdc-70afc3137e83 with status ACTIVE [ 799.924137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.924137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.926410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.926601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.926712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.926905] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.927028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.927093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.927250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.927323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.927509] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.927610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.927669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.927809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.927884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.927959] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1aad3b5-fee5-45a3-bfdc-70afc3137e83 is going to be updated. [ 799.949469] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.949651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.949715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.949924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.950086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.950266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1aad3b5-fee5-45a3-bfdc-70afc3137e83" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.049973] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.050229] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.050357] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.050627] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.050785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.050937] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port ef302599-f3e4-4e27-8dfb-431051e43b21 not found, creating... [ 800.051246] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.051405] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.051522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.051747] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.051887] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.052193] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.052347] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.052465] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.052710] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.052854] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.052992] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: ef302599-f3e4-4e27-8dfb-431051e43b21 is going to be created. [ 800.073294] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.073700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.073879] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.074776] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.075040] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.075893] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.097551] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.097727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.097727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.097929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.098028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.098118] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 already deleted. [ 800.098180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.336761] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff [ 800.337175] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.337384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.337527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.338096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.338096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.338279] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff already deleted. [ 800.338279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70fc6883-e5ac-45c7-9e3b-a2a3bcb9caff" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.427334] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.934220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.934220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.934220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.934220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.934220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.934220] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 is going to be created. [ 800.964536] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.964756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.964836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.965149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.965289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.978028] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 in Status: UNINITIALIZED for 2s [ 801.105023] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-e23ee692-8cae-4e25-b0fb-10dbaf0e35c1 service nova] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_rules [ 801.105023] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-e23ee692-8cae-4e25-b0fb-10dbaf0e35c1 service nova] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 801.105023] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-e23ee692-8cae-4e25-b0fb-10dbaf0e35c1 service nova] Enqueued Resource ID: ef302599-f3e4-4e27-8dfb-431051e43b21 with Priority: HIGHEST for action port [ 801.105023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_rules [ 801.105023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 801.105023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef302599-f3e4-4e27-8dfb-431051e43b21 with Priority: HIGHEST for action port [ 801.105023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.105023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.105596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.105979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.106192] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.107445] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.107691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.109015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.109015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.109015] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.109015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.109015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.109015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.109015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.109015] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.109881] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef302599-f3e4-4e27-8dfb-431051e43b21 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.110136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.110285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.110512] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.110664] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef302599-f3e4-4e27-8dfb-431051e43b21',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.360171] env[70032]: INFO networking_nsxv3.common.synchronization [req-96e01cd8-53bb-4351-a7bc-3eee7efdecd0 req-e9f9c3a9-a11e-4199-963c-159a881c9f8a tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_members [ 801.360171] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_members [ 801.360171] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.360171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.360171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.362207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.362551] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.362876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.363131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.366140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.366140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.366140] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.612116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.612312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.612489] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.613477] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef302599-f3e4-4e27-8dfb-431051e43b21 with status ACTIVE [ 801.613684] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.613811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.613870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.614100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.614195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.614367] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.614469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.614533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.614745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.614816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.614987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.619267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.619354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.619529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.619600] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.619719] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef302599-f3e4-4e27-8dfb-431051e43b21 is going to be updated. [ 801.642880] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.643032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.643117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.643330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.643462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.643642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef302599-f3e4-4e27-8dfb-431051e43b21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.868408] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.868582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.868654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.868864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.868953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.870017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.870017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.870017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.870017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.870017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.870017] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 already deleted. [ 801.870017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.910787] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.910981] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.911168] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.911510] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.911781] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.911934] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.914931] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.915239] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.915402] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.915620] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.915759] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.915878] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.915987] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.916149] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.916281] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.916427] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.934036] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.934200] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.934345] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.934519] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.936146] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.936146] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.936146] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.936146] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.936146] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4823606-12a7-4ee2-99ab-d1cfaa7b436d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.040821] env[70032]: INFO networking_nsxv3.common.synchronization [req-4b317bae-9a31-4710-8780-4f4b960b22ac req-b30659e4-27f5-4f1d-93ae-e556d15862cf tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 802.041048] env[70032]: INFO networking_nsxv3.common.synchronization [req-4b317bae-9a31-4710-8780-4f4b960b22ac req-b30659e4-27f5-4f1d-93ae-e556d15862cf tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_members [ 802.041544] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 802.041677] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_members [ 802.042176] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.042344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.042438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.042692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.043025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.043184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.043275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.043460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.043585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.043710] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.044982] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.045240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.045356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.045682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.045949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.046160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.046326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.046588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.046769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.047015] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [req-4b317bae-9a31-4710-8780-4f4b960b22ac req-b30659e4-27f5-4f1d-93ae-e556d15862cf tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_rules [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [req-4b317bae-9a31-4710-8780-4f4b960b22ac req-b30659e4-27f5-4f1d-93ae-e556d15862cf tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [req-4b317bae-9a31-4710-8780-4f4b960b22ac req-b30659e4-27f5-4f1d-93ae-e556d15862cf tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_rules [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [req-4b317bae-9a31-4710-8780-4f4b960b22ac req-b30659e4-27f5-4f1d-93ae-e556d15862cf tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_members [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [req-4b317bae-9a31-4710-8780-4f4b960b22ac req-b30659e4-27f5-4f1d-93ae-e556d15862cf tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c with Priority: HIGHEST for action port [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_rules [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_rules [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c with Priority: HIGHEST for action port [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 802.087025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_members [ 802.087025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.087025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.087025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.087918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.087918] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.088555] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.088768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.088902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.089198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.090129] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.090310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.090423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.090559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.090839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.090996] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd667efd-e2ca-45d6-b9c0-19f93cfb551c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.094211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.094211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.094684] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.094791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.257955] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.438939] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.442128] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a4823606-12a7-4ee2-99ab-d1cfaa7b436d not found, creating... [ 802.442128] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.442128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.442678] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.442678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.442678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.442678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.442678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.442678] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a4823606-12a7-4ee2-99ab-d1cfaa7b436d is going to be created. [ 802.462990] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.462990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.462990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.462990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.462990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.462990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.550871] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.551934] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.595898] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.596120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.596251] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd667efd-e2ca-45d6-b9c0-19f93cfb551c with status ACTIVE [ 802.596417] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.596513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.596580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.596797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.596885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.597063] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.597152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.597211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.597361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.597434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.597609] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.597704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.597749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.597884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.597953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.598043] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c is going to be updated. [ 802.601027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.601027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.620570] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.620728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.620776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.620972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.621130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.621273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.760148] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.760376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.760376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.760589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.760683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.760795] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be created. [ 802.782436] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.782526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.782645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.782844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.783020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.800835] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: UNINITIALIZED for 2s [ 802.926545] env[70032]: INFO networking_nsxv3.common.synchronization [req-c277053c-47fa-4a8f-9940-8068ac9559d7 req-cfb72771-6905-47cc-b5cc-289659fd98b1 tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 802.926545] env[70032]: INFO networking_nsxv3.common.synchronization [req-c277053c-47fa-4a8f-9940-8068ac9559d7 req-cfb72771-6905-47cc-b5cc-289659fd98b1 tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_members [ 802.927171] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 802.927446] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 with Priority: HIGHEST for action security_group_members [ 802.928419] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.928649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.928997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.929234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.956903] env[70032]: INFO networking_nsxv3.common.synchronization [req-f6de7045-6746-40fe-bfaf-74b77474cc5f req-a5efbbea-e68e-4bc4-a4da-6c47597acec2 tempest-FloatingIPsAssociationTestJSON-445852628 tempest-FloatingIPsAssociationTestJSON-445852628-project-member] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 802.957413] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 802.957713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.957833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.957902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.958188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.958309] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.958407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.958469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.958617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.958705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.958795] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.986036] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 in Status: SUCCESS [ 802.986328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.986890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.987089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.987278] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.987391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.987453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.987693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.987693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.987783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.987844] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.053945] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.054893] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.212778] env[70032]: INFO networking_nsxv3.common.synchronization [req-c277053c-47fa-4a8f-9940-8068ac9559d7 req-cfb72771-6905-47cc-b5cc-289659fd98b1 tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_rules [ 803.212997] env[70032]: INFO networking_nsxv3.common.synchronization [req-c277053c-47fa-4a8f-9940-8068ac9559d7 req-cfb72771-6905-47cc-b5cc-289659fd98b1 tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 803.213135] env[70032]: INFO networking_nsxv3.common.synchronization [req-c277053c-47fa-4a8f-9940-8068ac9559d7 req-cfb72771-6905-47cc-b5cc-289659fd98b1 tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c with Priority: HIGHEST for action port [ 803.213617] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_rules [ 803.213780] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 803.216056] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c with Priority: HIGHEST for action port [ 803.216056] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.216056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.216056] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.216056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.216056] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.216056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.216056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.216056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.216056] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd667efd-e2ca-45d6-b9c0-19f93cfb551c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.448239] env[70032]: INFO networking_nsxv3.common.synchronization [req-96e01cd8-53bb-4351-a7bc-3eee7efdecd0 req-5786e019-921b-4d96-aa9e-8462f05e8920 service nova] Enqueued Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_rules [ 803.448493] env[70032]: INFO networking_nsxv3.common.synchronization [req-96e01cd8-53bb-4351-a7bc-3eee7efdecd0 req-5786e019-921b-4d96-aa9e-8462f05e8920 service nova] Enqueued Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_members [ 803.448752] env[70032]: INFO networking_nsxv3.common.synchronization [req-96e01cd8-53bb-4351-a7bc-3eee7efdecd0 req-5786e019-921b-4d96-aa9e-8462f05e8920 service nova] Enqueued Resource ID: a4823606-12a7-4ee2-99ab-d1cfaa7b436d with Priority: HIGHEST for action port [ 803.449570] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_rules [ 803.450825] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_members [ 803.451051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4823606-12a7-4ee2-99ab-d1cfaa7b436d with Priority: HIGHEST for action port [ 803.451689] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.455204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.455282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.455526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.455634] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.456773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.456899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.456973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.457193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.457367] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.457466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.457835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.457835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.457835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.457835] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.458754] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.458910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.459146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.460236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.460236] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4823606-12a7-4ee2-99ab-d1cfaa7b436d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.460877] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.490857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.491269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.491269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.491355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.491460] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.491661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.491661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.491762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.491849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.491934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.492111] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.492184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.492334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.492383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.492568] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.492568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.492746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.492746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.492879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.492930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.492999] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.557142] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.557142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.557303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.557478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.557748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.557901] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 is going to be created. [ 803.563022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.563022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.563022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.563022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.563022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.563022] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be updated. [ 803.589052] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.589280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.589343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.589584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.589783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.596053] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.596053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.596053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.596053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.596053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.600221] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 in Status: UNINITIALIZED for 2s [ 803.602624] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: IN_PROGRESS for 2s [ 803.716953] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd667efd-e2ca-45d6-b9c0-19f93cfb551c with status ACTIVE [ 803.717122] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.717191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.717634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.717634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.717634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.717753] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.717800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.717880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.718211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.718211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.718359] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.718451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.718511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.718649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.718725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.718808] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd667efd-e2ca-45d6-b9c0-19f93cfb551c is going to be updated. [ 803.745327] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.747233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.747233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.747233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.747233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.747233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd667efd-e2ca-45d6-b9c0-19f93cfb551c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.961798] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.962908] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.963069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.963391] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4823606-12a7-4ee2-99ab-d1cfaa7b436d with status ACTIVE [ 803.963552] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.963665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.963722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.966938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.966938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.966938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.966938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.966938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.966938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.971018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.971018] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.971018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.971018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.971018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.971018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.971018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4823606-12a7-4ee2-99ab-d1cfaa7b436d is going to be updated. [ 803.971018] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.985155] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-163a6165-d040-4d7f-94ac-95ac471b039b tempest-ListServersNegativeTestJSON-226060042 tempest-ListServersNegativeTestJSON-226060042-project-member] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 803.985852] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 803.986181] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.986293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.989060] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.989183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.989253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.989463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.989598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.989745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4823606-12a7-4ee2-99ab-d1cfaa7b436d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.995923] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55c6c5eb-e161-4d2f-aadb-6f74ba12d141: rpc.has_security_group_logging(os_id): False [ 804.013603] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.017045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.017045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.017045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.017575] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.017575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.017575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.017575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.017575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.017575] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 is going to be created. [ 804.080817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.080817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.080817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.080817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.080817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.094401] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 in Status: IN_PROGRESS for 2s [ 804.324544] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-959 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.324766] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.324905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.325185] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.325447] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.325601] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.325747] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.326330] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.326494] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.326706] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.326821] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.326933] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.327072] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.327199] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.327307] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.327438] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.346681] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.346884] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.347389] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.347624] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.347927] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-bba3b332-9fbc-4998-bd9c-fcc140dbd274 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.348122] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.348309] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.348645] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.348787] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bba3b332-9fbc-4998-bd9c-fcc140dbd274',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.464445] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.472463] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.472647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.472719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.473635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.473635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.473635] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be updated. [ 804.500083] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.500235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.500306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.500516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.500652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.508722] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: IN_PROGRESS for 2s [ 804.813662] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 804.813662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.813662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.813662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.813662] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.813662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.813662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.815020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.815020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.815020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.815020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.816236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.817990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.817990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.817990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.817990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.817990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.817990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.817990] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.854264] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.854264] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port bba3b332-9fbc-4998-bd9c-fcc140dbd274 not found, creating... [ 804.854264] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.854264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.855902] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.856150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.856330] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.856660] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.856901] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.857149] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: bba3b332-9fbc-4998-bd9c-fcc140dbd274 is going to be created. [ 804.894647] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.894647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.894647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.894647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.894647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.894647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.968377] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.968809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.968809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.968987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.969117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.969259] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 is going to be created. [ 805.002173] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.002173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.002173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.002490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.002663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.016630] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 in Status: UNINITIALIZED for 2s [ 805.319262] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.319417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.319621] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.616110] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 in Status: SUCCESS [ 805.616387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.617067] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 805.617260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.617462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.619192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.619192] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.619192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.619192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.619192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.619192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.619192] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.619192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.619591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.619591] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.619728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.619812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.619979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.620095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.620211] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.753699] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-907b9321-5712-4de5-9415-2a3015ad49ea service nova] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_rules [ 805.753699] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-907b9321-5712-4de5-9415-2a3015ad49ea service nova] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 805.753699] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-907b9321-5712-4de5-9415-2a3015ad49ea service nova] Enqueued Resource ID: bba3b332-9fbc-4998-bd9c-fcc140dbd274 with Priority: HIGHEST for action port [ 805.753699] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_rules [ 805.753699] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 805.753699] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bba3b332-9fbc-4998-bd9c-fcc140dbd274 with Priority: HIGHEST for action port [ 805.754280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.754405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.754569] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.754650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.754882] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-bba3b332-9fbc-4998-bd9c-fcc140dbd274 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.754983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.755112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.755558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.755558] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bba3b332-9fbc-4998-bd9c-fcc140dbd274',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.825318] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.105351] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 in Status: SUCCESS [ 806.105589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.122399] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.122399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.122399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.122659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.122715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.122921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.123040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.123107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.123252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.123388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.123461] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 is going to be deleted. [ 806.124428] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.181802] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.181954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.182042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.182356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.182458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.182564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.182750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.183794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.184063] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.184304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.184384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.184542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.184626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.184737] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.259355] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bba3b332-9fbc-4998-bd9c-fcc140dbd274 with status ACTIVE [ 806.259916] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.259916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.259916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.260295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.260295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.260295] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.260389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.260421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.260563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.260643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.260828] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.260916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.260971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.261133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.261215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.261311] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bba3b332-9fbc-4998-bd9c-fcc140dbd274 is going to be updated. [ 806.284339] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.284430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.284504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.284738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.285040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.285225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bba3b332-9fbc-4998-bd9c-fcc140dbd274" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.333919] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.333919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.333919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.333919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.333919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.333919] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 806.375261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.375261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.375261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.375261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.375261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.384903] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 806.520462] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: SUCCESS [ 806.520462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.628025] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.688454] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.688618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.688692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.688909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.689018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.689606] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.689606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.689606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.689800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.689865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.689999] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 already deleted. [ 806.690238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.690363] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.691194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.692010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.692101] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.692205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.692448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.692659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.692797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.692797] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.027101] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 in Status: SUCCESS [ 807.027101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.027101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.028423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.028423] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.028423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.028423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.028423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.028423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.028423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.028423] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.130097] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.130486] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.130577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.130795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.130887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.131233] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be updated. [ 807.164854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.165027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.165105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.165319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.165473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.175995] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: IN_PROGRESS for 2s [ 807.194885] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.199636] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.199772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.199843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.200074] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.200168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.200360] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.200459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.200522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.200674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.200750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.200834] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 already deleted. [ 807.200911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.530813] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.700038] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6: rpc.has_security_group_logging(os_id): False [ 807.717063] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.717237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.717299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.717556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.717659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.717925] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.718056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.718110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.718272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.718367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.718462] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 is going to be created. [ 807.735620] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6], does not exist path=[/infra/domains/default/groups/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6]."\n}' [ 807.735783] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 [ 807.735903] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 807.784881] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.785167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.785289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.785639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.787020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.787539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.787539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.787539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.787741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.787839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.788058] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.788165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.788392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.788392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.788547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.788547] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 is going to be created. [ 807.825948] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6], does not exist path=[/infra/domains/default/groups/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 [ 807.826154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.826723] env[70032]: Traceback (most recent call last): [ 807.826771] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 807.826771] env[70032]: return func(*args, **kwargs) [ 807.826771] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.826771] env[70032]: res.raise_for_status() [ 807.826771] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.826771] env[70032]: raise HTTPError(http_error_msg, response=self) [ 807.826771] env[70032]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 [ 807.826771] env[70032]: During handling of the above exception, another exception occurred: [ 807.826771] env[70032]: Traceback (most recent call last): [ 807.826985] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 807.826985] env[70032]: listener.cb(fileno) [ 807.826985] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 807.826985] env[70032]: result = function(*args, **kwargs) [ 807.826985] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 807.826985] env[70032]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 807.826985] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 807.826985] env[70032]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 807.826985] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 807.826985] env[70032]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 807.826985] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.826985] env[70032]: res.raise_for_status() [ 807.826985] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.826985] env[70032]: raise HTTPError(http_error_msg, response=self) [ 807.826985] env[70032]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d3ce5cb7-8bf2-456c-b651-4b29a70ed6d6 [ 807.826985] env[70032]: Removing descriptor: 20 [ 808.033085] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4ccf82f-3b6f-46ee-bfb8-395c2be74f50: rpc.has_security_group_logging(os_id): False [ 808.050390] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.050611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.050611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.050849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.050941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.051217] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.051310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.051373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.051526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.051606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.051694] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 is going to be created. [ 808.107671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.107671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.107671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.107671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.107671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.118501] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 in Status: IN_PROGRESS for 2s [ 808.396072] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 808.396072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.396072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.396072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.396072] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.398009] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.399040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.399040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.399040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.399040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.399040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.399040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.399040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.399040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.399353] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.399353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.399474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.400429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.400673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.400673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.402119] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.403035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.405865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.405865] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.405865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.405865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.405865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.405865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.405865] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.909018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0: rpc.has_security_group_logging(os_id): False [ 808.909551] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.926290] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.926473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.926534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.926696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.926773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.926961] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.927057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.927184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.927297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.927356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.927532] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.927948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.927948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.927948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.927948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.928371] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.928371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.928371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.928371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.928506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.928506] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be created. [ 808.981633] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.981917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.981917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.982139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.982279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.994208] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 809.186720] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 809.186930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.187117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.187341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.187650] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.187650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.187824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.187873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.187914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.187997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.188571] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.189231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.189231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.189394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.189394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.189539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.189539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.189633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.189692] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.411797] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.650642] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d92099e6-ff31-416d-b84e-f56aea78d5d7 tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 59b6c927-c21a-460a-bfeb-a99335f27a48 with Priority: HIGHEST for action security_group_rules [ 809.651134] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b6c927-c21a-460a-bfeb-a99335f27a48 with Priority: HIGHEST for action security_group_rules [ 809.651435] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59b6c927-c21a-460a-bfeb-a99335f27a48 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.651555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.651619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.651868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.651954] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59b6c927-c21a-460a-bfeb-a99335f27a48',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.691164] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.691236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.693871] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.768786] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b112dc94-cf0a-4c26-a15e-38d163d8719b tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 59b6c927-c21a-460a-bfeb-a99335f27a48 with Priority: HIGHEST for action security_group_rules [ 809.769682] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b6c927-c21a-460a-bfeb-a99335f27a48 with Priority: HIGHEST for action security_group_rules [ 809.770772] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59b6c927-c21a-460a-bfeb-a99335f27a48 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.770772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.915053] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.918031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.918031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.918031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.918031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.918031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 809.971830] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.972155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.972298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.972665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.973016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.990217] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 810.137666] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 in Status: SUCCESS [ 810.137666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.183288] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.183288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.183288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.183976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.184285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.184525] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59b6c927-c21a-460a-bfeb-a99335f27a48 already deleted. [ 810.186313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.186313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.186313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.186313] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59b6c927-c21a-460a-bfeb-a99335f27a48',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.196884] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.481132] env[70032]: INFO networking_nsxv3.common.synchronization [req-6ff52cf4-e234-4bcc-8ee0-39f03291ddd1 req-d76d6116-7341-4de6-96e6-44b7ee924b57 tempest-ServerGroupTestJSON-1373147721 tempest-ServerGroupTestJSON-1373147721-project-member] Enqueued Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_members [ 810.481132] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGHEST for action security_group_members [ 810.481132] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.481132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.481132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.481132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.481132] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.481132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.481132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.481132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.481132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.481132] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.699948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.699948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.699948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.700158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.700158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.700229] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be updated. [ 810.723362] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.723563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.723647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.723928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.724059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.724195] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59b6c927-c21a-460a-bfeb-a99335f27a48 already deleted. [ 810.724298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59b6c927-c21a-460a-bfeb-a99335f27a48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.733023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.733183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.733246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.733446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.733597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.742639] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: IN_PROGRESS for 2s [ 810.984858] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.985224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.985224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.985323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.004240] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 811.004496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.004666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.004960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.005060] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.007233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.007233] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.007233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.007233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.008062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.008407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.009052] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 is going to be updated. [ 811.033412] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.033571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.033658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.033928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.034105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.049028] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 in Status: IN_PROGRESS for 2s [ 811.512241] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.512377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.000753] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 812.000753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.000753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.001236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.001236] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.001322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.001322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.001661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.001661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.001661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.001827] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.067801] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-eb1b6012-3c73-40f3-a3e3-b5154f6dfcef tempest-ListServersNegativeTestJSON-226060042 tempest-ListServersNegativeTestJSON-226060042-project-member] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 812.068338] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 812.068965] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.068965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.068965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.069122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.073208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.073266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.073302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.073481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.073599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.073699] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.425510] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-959 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.425676] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.425739] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.426240] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.426347] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.426453] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.427026] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.427026] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.427142] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.427347] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.427469] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.427583] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.427694] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.427808] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.427920] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.428068] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.447820] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.447820] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.447941] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.448740] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-959" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.448740] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.448740] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.448740] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.449219] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.449652] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.505087] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.505087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.578491] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.754555] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 812.754778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.754925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.755158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.755357] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.755489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.755562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.755710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.755835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.755925] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.952050] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.952321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.952365] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.952842] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.952943] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.953194] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 not found, creating... [ 812.953410] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.953517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.953679] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.953845] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.953985] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.954277] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.954436] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.954565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.954750] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.954947] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.955210] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 is going to be created. [ 812.974478] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.974753] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.975029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.975391] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.975633] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.975915] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.058077] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 in Status: SUCCESS [ 813.058363] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 deletion is rescheduled due to dependency. [ 813.058363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.083891] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.257845] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.587525] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.587695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.587769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.587983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.588096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.588197] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 813.617674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.617828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.617902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.618200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.618538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.628479] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 813.670295] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-021bec89-88f8-475f-b731-532a7f38d838 service nova] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_rules [ 813.670295] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-021bec89-88f8-475f-b731-532a7f38d838 service nova] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 813.670295] env[70032]: INFO networking_nsxv3.common.synchronization [req-dfebae68-f923-4626-b264-7aaba445e2a9 req-021bec89-88f8-475f-b731-532a7f38d838 service nova] Enqueued Resource ID: ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 with Priority: HIGHEST for action port [ 813.670295] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_rules [ 813.670747] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 813.670747] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 with Priority: HIGHEST for action port [ 813.671321] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.671321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.671466] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.671536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.671702] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.671791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.671854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.672068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.672168] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.734504] env[70032]: INFO networking_nsxv3.common.synchronization [req-b00497d3-137c-4454-b7ed-1ec188465e3f req-d36c4ece-7212-4f55-b0cd-5c5a3e0984e6 tempest-ServerRescueTestJSONUnderV235-551022415 tempest-ServerRescueTestJSONUnderV235-551022415-project-member] Enqueued Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 813.735068] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef with Priority: HIGHEST for action security_group_members [ 813.738580] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.738580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.761038] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.176067] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 with status ACTIVE [ 814.176067] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.176429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.176429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.176571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.176712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.176892] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.177032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.177142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.177291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.177424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.177563] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.177633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.177694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.177820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.177895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.178020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9 is going to be updated. [ 814.209968] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.210157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.210231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.210435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.210568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.210729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba4bcf85-2361-46c2-9fd6-fa0af1b50ff9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.262124] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.262279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.262351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.262555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.262646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.262766] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be updated. [ 814.297032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.297169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.297245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.297474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.297618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.306298] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: IN_PROGRESS for 2s [ 814.611114] env[70032]: INFO networking_nsxv3.common.synchronization [req-e3812d7e-7a2f-4039-85ba-e3f6f96c4622 req-0ae32ca2-f57a-43d2-b8ba-91b6bbe53842 tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 814.611114] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 814.611114] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.611114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.611114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.611114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.611114] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.611114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.611114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.611616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.611814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.611996] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.898020] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.898020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.898020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.898020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.898020] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.898020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.898020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.898677] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.898943] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.899279] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.899495] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.899687] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.899875] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.900094] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.900291] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.900506] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.941020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.941020] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.941020] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.941020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.941020] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-48bbe5c3-e520-4927-a634-f561782124c1 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.941020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.941020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.941020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.941020] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48bbe5c3-e520-4927-a634-f561782124c1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.114459] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.114570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.114570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.114765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.133685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.133996] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.134189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.134245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.134468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.134612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.134728] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 815.165290] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.165290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.165290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.165290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.165290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.184861] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 815.445114] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.445389] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.445473] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.445732] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.445923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.446113] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 48bbe5c3-e520-4927-a634-f561782124c1 not found, creating... [ 815.446388] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.446614] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.446663] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.446882] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.447032] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.447315] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.447485] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.447581] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.447781] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.447914] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.448074] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 48bbe5c3-e520-4927-a634-f561782124c1 is going to be created. [ 815.466561] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.466756] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.466883] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.467182] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.467410] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.467630] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.642687] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 815.642687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.643022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.643022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.643777] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.643777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.643777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.643777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.643987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.643987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.644124] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.644202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.644259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.644397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.644529] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.644624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.644680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.644813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.644900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.645406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.645406] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.645888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.646073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.646219] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.646308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.646368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.646503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.646576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.646657] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.149087] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0: rpc.has_security_group_logging(os_id): False [ 816.153681] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.171187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.171342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.171414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.171620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.171714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.171901] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.172008] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.172076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.172225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.172302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.172490] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.172582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.172643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.173077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.173166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.173414] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.173566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.173664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.173839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.173924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.174041] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 816.195360] env[70032]: INFO networking_nsxv3.common.synchronization [req-e3812d7e-7a2f-4039-85ba-e3f6f96c4622 req-c69746d5-8480-4b23-bd93-b565e89f5bb2 service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 816.195360] env[70032]: INFO networking_nsxv3.common.synchronization [req-e3812d7e-7a2f-4039-85ba-e3f6f96c4622 req-c69746d5-8480-4b23-bd93-b565e89f5bb2 service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 816.195803] env[70032]: INFO networking_nsxv3.common.synchronization [req-e3812d7e-7a2f-4039-85ba-e3f6f96c4622 req-c69746d5-8480-4b23-bd93-b565e89f5bb2 service nova] Enqueued Resource ID: 48bbe5c3-e520-4927-a634-f561782124c1 with Priority: HIGHEST for action port [ 816.195856] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 816.195988] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 816.196131] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48bbe5c3-e520-4927-a634-f561782124c1 with Priority: HIGHEST for action port [ 816.196679] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.196842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.196930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.197181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.197297] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.198190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.198290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.198472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-48bbe5c3-e520-4927-a634-f561782124c1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.198562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.198673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.198982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.198982] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48bbe5c3-e520-4927-a634-f561782124c1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.261363] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.261546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.261640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.261853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.262012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.275766] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 816.324344] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 816.324618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.324797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.326293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.326565] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.326725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.326815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.327061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.327182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.327310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.327552] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-38545a1e-8581-4dfd-b549-14a8b50d98ef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.327741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.327741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.327956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.329076] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.329259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.329368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.329606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.329745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.329889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.330065] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.333109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.333109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.333109] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.333109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.333109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.333109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.333109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.333109] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.659359] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.701073] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.701216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.703900] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48bbe5c3-e520-4927-a634-f561782124c1 with status ACTIVE [ 816.704110] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.704232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.704299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.704507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.704600] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.704776] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.704975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.704975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.705205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.705270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.705414] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.705507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.705566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.705701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.705775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.705857] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48bbe5c3-e520-4927-a634-f561782124c1 is going to be updated. [ 816.727130] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.727328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.727391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.727569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.727716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.727881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48bbe5c3-e520-4927-a634-f561782124c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.834434] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.834592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.834657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.834910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.836043] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38545a1e-8581-4dfd-b549-14a8b50d98ef: rpc.has_security_group_logging(os_id): False [ 816.857242] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.857393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.863469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.863693] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.863784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.863784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.863995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.864048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.864140] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be updated. [ 816.865054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.865228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.865319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.865553] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.865707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.865884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.866025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.866078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.866279] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.866374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.866441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.866583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.866662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.866844] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.866931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.866996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.867195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.867278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.867366] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be updated. [ 816.899293] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.899448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.899523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.899777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.899811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.907611] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: IN_PROGRESS for 2s [ 816.936700] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.937018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.937201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.937612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.937794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.949295] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: IN_PROGRESS for 2s [ 817.161844] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.162015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.162098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.162313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.162412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.162512] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 817.202581] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 817.202980] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a deletion is rescheduled due to dependency. [ 817.203076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.203282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.203602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.204052] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.204255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.204376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.204626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.204768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.204939] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.207775] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.207876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.207950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.208191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.208261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.217969] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 817.707465] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.210600] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.260613] env[70032]: INFO networking_nsxv3.common.synchronization [None req-5b181fa2-6c03-45cc-9362-d73986af33b7 tempest-MigrationsAdminTest-411767673 tempest-MigrationsAdminTest-411767673-project-member] Enqueued Resource ID: 6bbe7d22-c999-4a79-a07e-2f930271e368 with Priority: HIGHEST for action security_group_rules [ 818.261163] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bbe7d22-c999-4a79-a07e-2f930271e368 with Priority: HIGHEST for action security_group_rules [ 818.261464] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bbe7d22-c999-4a79-a07e-2f930271e368 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.261658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.261658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.261913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.262029] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bbe7d22-c999-4a79-a07e-2f930271e368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.290295] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 818.290295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.290295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.290295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.290295] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.355077] env[70032]: INFO networking_nsxv3.common.synchronization [None req-45204446-4b9d-42e4-bcb3-c99d4bda883a tempest-MigrationsAdminTest-411767673 tempest-MigrationsAdminTest-411767673-project-member] Enqueued Resource ID: 6bbe7d22-c999-4a79-a07e-2f930271e368 with Priority: HIGHEST for action security_group_rules [ 818.355790] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bbe7d22-c999-4a79-a07e-2f930271e368 with Priority: HIGHEST for action security_group_rules [ 818.355858] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bbe7d22-c999-4a79-a07e-2f930271e368 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.355982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.714836] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.714836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.714836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.714836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.714836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.714836] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 818.740705] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.740859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.740930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.741159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.741294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.749693] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 818.788171] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.788290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.788366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.788570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.788663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.788759] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bbe7d22-c999-4a79-a07e-2f930271e368 already deleted. [ 818.788843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.788998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.789180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.789699] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bbe7d22-c999-4a79-a07e-2f930271e368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.794391] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.794510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.916800] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 818.916984] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef deletion is rescheduled due to dependency. [ 818.917115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.963183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef in Status: SUCCESS [ 818.963432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.963610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.963857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.963948] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38545a1e-8581-4dfd-b549-14a8b50d98ef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.228028] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 819.228028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.228355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.228388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.228582] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.228700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.228796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.229705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.229705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.229705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.229705] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.308477] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.308623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.308694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.308901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.308994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.309107] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bbe7d22-c999-4a79-a07e-2f930271e368 already deleted. [ 819.309396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bbe7d22-c999-4a79-a07e-2f930271e368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.488259] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.488399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.488473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.488690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.488831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.488883] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38545a1e-8581-4dfd-b549-14a8b50d98ef is going to be deleted. [ 819.563280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.563414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.563414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.563622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.563713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.563828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38545a1e-8581-4dfd-b549-14a8b50d98ef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.732385] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.732500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.733045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.733045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.733190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.733357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.733472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.733708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.733860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.734014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.734820] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.734820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.734820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.734820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.735150] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.735150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.735150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.735291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.735453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.735453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.735547] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.238311] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0: rpc.has_security_group_logging(os_id): False [ 820.254772] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.254944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.255039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.255264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.255361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.255559] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.255681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.255739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.255867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.255947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.256310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.256310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.256456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.256485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.256548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.256737] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.256829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.256892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.257037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.257116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.257245] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 820.313758] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.314069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.314069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.315151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.315151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.327078] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 820.759404] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 820.759618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.759787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.761872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.761872] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.761872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.761872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.761872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.761872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.761872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.761872] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.266079] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.266079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.266079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.266079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.266506] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.266506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.266506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.266616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.266660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.266756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.266890] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.267329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.267329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.267437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.267526] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.267634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.267691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.267864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.268034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.268197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.268312] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.771234] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1d61d13-44e5-4c83-936b-8a6c378d760a: rpc.has_security_group_logging(os_id): False [ 821.789353] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.789534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.789627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.789860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.789981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.790237] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.790442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.790537] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.790769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.791076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.791315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.791447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.791598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.791797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.791879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.792081] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.792180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.792245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.792386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.792460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.792543] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 821.847987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.848167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.848239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.848456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.848598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.859545] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 822.339822] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 822.340191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.619070] env[70032]: INFO networking_nsxv3.common.synchronization [req-49ab13c7-d2fd-40f6-b0e0-c2eb96961b48 req-bd42fa0b-9c7e-403a-981b-e36b2e507177 tempest-ServersWithSpecificFlavorTestJSON-1841008358 tempest-ServersWithSpecificFlavorTestJSON-1841008358-project-member] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 822.619285] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 822.619959] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.620188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.620229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.620634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.620634] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.621026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.621026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.621026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.621177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.621223] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.123350] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.123532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.123607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.123826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.145016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.145655] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.145655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.145655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.145655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.145853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.145853] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef is going to be updated. [ 823.173108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.173293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.173293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.173498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.173644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.181857] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: IN_PROGRESS for 2s [ 823.873059] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 823.873510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.609820] env[70032]: INFO networking_nsxv3.common.synchronization [req-225007d4-ec14-40a9-98b5-4f1f16e2808c req-eedc4c28-36bc-4839-8ffe-ae2dd3675186 tempest-ServerDiagnosticsNegativeTest-552375318 tempest-ServerDiagnosticsNegativeTest-552375318-project-member] Enqueued Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_members [ 824.610388] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_members [ 824.610691] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.611373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.611373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.611373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.611534] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.611534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.611631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.611723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.612084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.612084] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.011470] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.011769] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.011892] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.012063] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.012322] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.012479] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.012599] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.012817] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.014095] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.014095] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.014095] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.014095] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.014095] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.014095] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.014095] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.014095] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.046031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.046256] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.046417] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.046600] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.046916] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.047126] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.047267] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.047747] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.047747] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f49efd38-7bac-4f5f-9ace-ffe509cefe0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.103908] env[70032]: INFO networking_nsxv3.common.synchronization [req-5dbb434f-0a98-4411-96eb-d1b65fb4a663 req-6ddc6dec-fdf2-4755-8fe5-8cd7d96bfc86 tempest-ListServersNegativeTestJSON-226060042 tempest-ListServersNegativeTestJSON-226060042-project-member] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 825.104410] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 825.104716] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.104839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.104911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.105154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.105307] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.105409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.105474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.105625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.105711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.105802] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.114076] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.114198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.114272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.114458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.114549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.114953] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.114953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.114953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.115182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.115182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.115245] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 already deleted. [ 825.115335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.192691] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: SUCCESS [ 825.192876] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef deletion is rescheduled due to dependency. [ 825.192990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.551246] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.551479] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.551600] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.551885] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.552080] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.552260] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port f49efd38-7bac-4f5f-9ace-ffe509cefe0a not found, creating... [ 825.552518] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.552673] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.552810] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.553619] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.553619] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.553619] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.553619] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.553817] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.553942] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.554161] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.554441] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: f49efd38-7bac-4f5f-9ace-ffe509cefe0a is going to be created. [ 825.572140] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.572332] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.572458] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.572744] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.573103] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.573330] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.607875] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.110090] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.268433] env[70032]: INFO networking_nsxv3.common.synchronization [req-225007d4-ec14-40a9-98b5-4f1f16e2808c req-38cd7e49-3638-4ea0-91ba-af7fe9a3b7d1 service nova] Enqueued Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_rules [ 826.268579] env[70032]: INFO networking_nsxv3.common.synchronization [req-225007d4-ec14-40a9-98b5-4f1f16e2808c req-38cd7e49-3638-4ea0-91ba-af7fe9a3b7d1 service nova] Enqueued Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_members [ 826.268723] env[70032]: INFO networking_nsxv3.common.synchronization [req-225007d4-ec14-40a9-98b5-4f1f16e2808c req-38cd7e49-3638-4ea0-91ba-af7fe9a3b7d1 service nova] Enqueued Resource ID: f49efd38-7bac-4f5f-9ace-ffe509cefe0a with Priority: HIGHEST for action port [ 826.269037] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_rules [ 826.269313] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_members [ 826.269442] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f49efd38-7bac-4f5f-9ace-ffe509cefe0a with Priority: HIGHEST for action port [ 826.270307] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.270411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.270481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.270727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.270813] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.272647] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.272647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.272647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.272647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.272647] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.272647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.272647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.272647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.272647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.272647] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.273346] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.273453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.273518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.273821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.273821] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f49efd38-7bac-4f5f-9ace-ffe509cefe0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.612692] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.612853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.612958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.613161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.613255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.613352] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 826.641940] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.641940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.641940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.641940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.641940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.648849] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 826.776493] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.776493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.776493] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.781233] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f49efd38-7bac-4f5f-9ace-ffe509cefe0a with status ACTIVE [ 826.781455] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.781587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.781661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.781869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.782089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.782162] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.782334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.782334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.782478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.782555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.782742] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.782825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.782891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.783112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.783200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.783282] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f49efd38-7bac-4f5f-9ace-ffe509cefe0a is going to be updated. [ 826.802797] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.803104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.803104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.803232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.803362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.803521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f49efd38-7bac-4f5f-9ace-ffe509cefe0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.282349] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.784904] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.785136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.785229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.785456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.785552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.785654] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 is going to be created. [ 827.807734] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.808261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.808261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.808261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.808484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.818834] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 in Status: UNINITIALIZED for 2s [ 828.658589] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 828.658946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.551459] env[70032]: INFO networking_nsxv3.common.synchronization [None req-10fb10ba-d66a-4935-8024-ba74497a9234 None None] Enqueued Resource ID: 747c8e58-c1c4-4a1a-8789-4ed02646aaef with Priority: HIGHEST for action port [ 829.551459] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747c8e58-c1c4-4a1a-8789-4ed02646aaef with Priority: HIGHEST for action port [ 829.551459] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-747c8e58-c1c4-4a1a-8789-4ed02646aaef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.551459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-747c8e58-c1c4-4a1a-8789-4ed02646aaef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.551459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-747c8e58-c1c4-4a1a-8789-4ed02646aaef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.551459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-747c8e58-c1c4-4a1a-8789-4ed02646aaef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.551459] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('747c8e58-c1c4-4a1a-8789-4ed02646aaef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.831941] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 in Status: SUCCESS [ 829.832266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.832320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.832613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.832989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.832989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.833159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.833349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.833349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.833460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.833537] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.054039] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 747c8e58-c1c4-4a1a-8789-4ed02646aaef [ 830.054310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.054461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.054534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.054813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.054997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.055083] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:747c8e58-c1c4-4a1a-8789-4ed02646aaef already deleted. [ 830.055214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-747c8e58-c1c4-4a1a-8789-4ed02646aaef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.335518] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.336935] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.336935] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.336935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.337427] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.337427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.337427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.337427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.337427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.337569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.337596] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.841145] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29db5c69-ae7f-4532-a586-567cdaa588c3: rpc.has_security_group_logging(os_id): False [ 830.860770] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.861344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.861550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.862014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.862131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.862616] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.862964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.863111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.863406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.863591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.863949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.864188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.864348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.864553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.864690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.865192] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.865285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.865348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.865774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.865774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.865865] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 is going to be created. [ 830.920381] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.920894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.923023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.923023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.923023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.933744] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 in Status: IN_PROGRESS for 2s [ 831.453859] env[70032]: INFO networking_nsxv3.common.synchronization [req-3bab664e-3272-4fe7-9827-5cab15941743 req-1a847b0b-df00-438c-abe6-73fdec7609c0 tempest-ServerPasswordTestJSON-598535803 tempest-ServerPasswordTestJSON-598535803-project-member] Enqueued Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_members [ 831.453955] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_members [ 831.454220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2dd745-ad31-4195-9f0e-c534fa480580 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.454339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.454409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.454659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.454810] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.454907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.454987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.456428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.456428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.456546] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.792947] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.793194] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-634" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.793567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-634" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.793706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-634" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.794034] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.794230] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.794389] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.794633] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.794813] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.795174] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.795311] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.795462] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.795524] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.795624] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.795715] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.795850] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.813350] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.813516] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.813688] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.813791] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-634" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.814122] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7d839b44-fb12-4b49-8f90-38aed3b000fc taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.814303] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.814423] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.814731] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.815533] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d839b44-fb12-4b49-8f90-38aed3b000fc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.961398] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.961398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.961398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.961398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.961719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.961719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.961791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.961844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.962307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.962307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.962307] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 already deleted. [ 831.962307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.049192] env[70032]: INFO networking_nsxv3.common.synchronization [None req-9c5427eb-439e-4df1-9490-cc55112cde93 None None] Enqueued Resource ID: ee83b7b6-cbd1-465b-8fc8-be5c47fd619c with Priority: HIGHEST for action port [ 832.049848] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee83b7b6-cbd1-465b-8fc8-be5c47fd619c with Priority: HIGHEST for action port [ 832.050338] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee83b7b6-cbd1-465b-8fc8-be5c47fd619c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.050646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee83b7b6-cbd1-465b-8fc8-be5c47fd619c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.050797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee83b7b6-cbd1-465b-8fc8-be5c47fd619c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.051185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee83b7b6-cbd1-465b-8fc8-be5c47fd619c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.051339] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee83b7b6-cbd1-465b-8fc8-be5c47fd619c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.319115] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.319411] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.319567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.319886] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.320074] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.320245] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7d839b44-fb12-4b49-8f90-38aed3b000fc not found, creating... [ 832.320511] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.320671] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.320789] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.321043] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.321192] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.321474] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.321631] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.321749] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.321958] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.322358] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.322553] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7d839b44-fb12-4b49-8f90-38aed3b000fc is going to be created. [ 832.342072] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.342283] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.342414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.342681] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.342897] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.343150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.554564] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee83b7b6-cbd1-465b-8fc8-be5c47fd619c [ 832.554864] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.555091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.555180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.555417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.555567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.555694] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee83b7b6-cbd1-465b-8fc8-be5c47fd619c already deleted. [ 832.555813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee83b7b6-cbd1-465b-8fc8-be5c47fd619c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.944822] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 in Status: SUCCESS [ 832.945415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.123437] env[70032]: INFO networking_nsxv3.common.synchronization [req-3bab664e-3272-4fe7-9827-5cab15941743 req-521d3418-3f9a-4936-a3c0-1199c1bf076c service nova] Enqueued Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_rules [ 833.123705] env[70032]: INFO networking_nsxv3.common.synchronization [req-3bab664e-3272-4fe7-9827-5cab15941743 req-521d3418-3f9a-4936-a3c0-1199c1bf076c service nova] Enqueued Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_members [ 833.123740] env[70032]: INFO networking_nsxv3.common.synchronization [req-3bab664e-3272-4fe7-9827-5cab15941743 req-521d3418-3f9a-4936-a3c0-1199c1bf076c service nova] Enqueued Resource ID: 7d839b44-fb12-4b49-8f90-38aed3b000fc with Priority: HIGHEST for action port [ 833.126324] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_rules [ 833.126324] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_members [ 833.126324] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d839b44-fb12-4b49-8f90-38aed3b000fc with Priority: HIGHEST for action port [ 833.126324] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e2dd745-ad31-4195-9f0e-c534fa480580 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.126324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.126324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.129792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.129792] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.132788] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2dd745-ad31-4195-9f0e-c534fa480580 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.132788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.132788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.132788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.132788] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.132788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.132788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.132788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.132788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.132788] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.134567] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d839b44-fb12-4b49-8f90-38aed3b000fc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.134675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.134741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.134906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.135023] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d839b44-fb12-4b49-8f90-38aed3b000fc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.638480] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.639633] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2dd745-ad31-4195-9f0e-c534fa480580 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.639927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.639927] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d839b44-fb12-4b49-8f90-38aed3b000fc with status ACTIVE [ 833.640092] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.643429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.643429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.643429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.643429] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d839b44-fb12-4b49-8f90-38aed3b000fc is going to be updated. [ 833.666144] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.666379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.666509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.666904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.667029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.667286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d839b44-fb12-4b49-8f90-38aed3b000fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.147553] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.225907] env[70032]: INFO networking_nsxv3.common.synchronization [None req-77a51e72-e0e6-4576-886d-7b08c5740b22 None None] Enqueued Resource ID: b6596682-7fa7-412f-835a-09225bd12fe7 with Priority: HIGHEST for action port [ 834.226677] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6596682-7fa7-412f-835a-09225bd12fe7 with Priority: HIGHEST for action port [ 834.227124] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6596682-7fa7-412f-835a-09225bd12fe7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.227643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6596682-7fa7-412f-835a-09225bd12fe7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.227643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6596682-7fa7-412f-835a-09225bd12fe7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.227907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6596682-7fa7-412f-835a-09225bd12fe7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.228051] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6596682-7fa7-412f-835a-09225bd12fe7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.651178] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.651342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.651525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.655066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.655066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.655066] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 is going to be created. [ 834.682489] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.682632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.683849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.684231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.684424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.698255] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 in Status: UNINITIALIZED for 2s [ 834.730398] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6596682-7fa7-412f-835a-09225bd12fe7 [ 834.731806] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.731806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.731806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.731806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.731806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.731806] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6596682-7fa7-412f-835a-09225bd12fe7 already deleted. [ 834.731806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6596682-7fa7-412f-835a-09225bd12fe7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.198400] env[70032]: INFO networking_nsxv3.common.synchronization [req-61918077-0a3c-4698-8b7a-bf56d7912072 req-0c2182aa-2b60-48f5-aaa4-e16649b2f142 tempest-ServerDiagnosticsNegativeTest-552375318 tempest-ServerDiagnosticsNegativeTest-552375318-project-member] Enqueued Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_members [ 836.199057] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGHEST for action security_group_members [ 836.199370] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.199649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.199649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.199863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.200568] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.202491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.202575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.203205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.203205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.203205] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.537629] env[70032]: INFO networking_nsxv3.common.synchronization [req-14d51e63-0128-438c-bcba-fab2cd9752bd req-1ec4bad7-85c3-4358-92e0-7f1dc3903918 tempest-VolumesAssistedSnapshotsTest-1282546720 tempest-VolumesAssistedSnapshotsTest-1282546720-project-member] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_members [ 836.537689] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_members [ 836.538338] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.538418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.538666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.538733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.539111] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.539111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.543374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.543374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.543374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.543374] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.707937] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.707937] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.707937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.707937] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 is going to be updated. [ 836.708781] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 in Status: SUCCESS [ 836.708943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.711978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.711978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.711978] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.711978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.711978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.711978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.711978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.711978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.711978] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.737779] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.737779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.738271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.738271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.738271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.747796] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 in Status: IN_PROGRESS for 2s [ 836.914297] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-387 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.914517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-387" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.914656] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-387" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.915197] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-387" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.915554] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.915803] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.915953] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.919916] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.919916] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.919916] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.919916] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.919916] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.919916] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.919916] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.919916] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.920255] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.938096] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.938275] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.938429] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.938633] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-387" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.938983] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-fb6227f8-2978-4633-b5ff-97a503859aaf taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.939319] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.939400] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.939745] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.939907] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6227f8-2978-4633-b5ff-97a503859aaf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.042674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.042833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.042906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.043163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.043265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.043611] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.043611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.043767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.043802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.044033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.044033] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f already deleted. [ 837.044033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.200198] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8bd99217-5fbd-4283-8d82-e6e6191241d6 None None] Enqueued Resource ID: 3cd7f0db-4769-466d-819c-ecc26678f2d5 with Priority: HIGHEST for action port [ 837.200521] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd7f0db-4769-466d-819c-ecc26678f2d5 with Priority: HIGHEST for action port [ 837.201120] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd7f0db-4769-466d-819c-ecc26678f2d5 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.201249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd7f0db-4769-466d-819c-ecc26678f2d5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.201319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd7f0db-4769-466d-819c-ecc26678f2d5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.201567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd7f0db-4769-466d-819c-ecc26678f2d5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.201659] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd7f0db-4769-466d-819c-ecc26678f2d5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.215366] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2dd745-ad31-4195-9f0e-c534fa480580 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.215435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.215592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.215685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.215844] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.215939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.215999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.216193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.216289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.216374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.216519] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2dd745-ad31-4195-9f0e-c534fa480580 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.216607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.216664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.216801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.216932] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.217029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.217082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.217216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.217288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.217388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.217479] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.445346] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.445346] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port fb6227f8-2978-4633-b5ff-97a503859aaf not found, creating... [ 837.445346] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.445346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.446091] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.446091] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.446743] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.447091] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.447611] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.447868] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: fb6227f8-2978-4633-b5ff-97a503859aaf is going to be created. [ 837.469661] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.469661] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.471428] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.471428] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.471428] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.471428] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.707410] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cd7f0db-4769-466d-819c-ecc26678f2d5 [ 837.707673] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.707813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.707885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.708131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.708228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.708325] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cd7f0db-4769-466d-819c-ecc26678f2d5 already deleted. [ 837.708408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd7f0db-4769-466d-819c-ecc26678f2d5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.720021] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e2dd745-ad31-4195-9f0e-c534fa480580: rpc.has_security_group_logging(os_id): False [ 837.743291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.743291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.743291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.743291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.743842] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.743842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.743842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.743842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.743842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.743842] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 is going to be created. [ 837.799031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.799031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.799031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.799031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.799031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.807209] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 in Status: IN_PROGRESS for 2s [ 837.846300] env[70032]: INFO networking_nsxv3.common.synchronization [None req-0f7e6464-0d7a-4468-8e4b-75297cdeed82 None None] Enqueued Resource ID: e940d90a-8ae0-4b03-ac51-c6d6e36e003d with Priority: HIGHEST for action port [ 837.847450] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e940d90a-8ae0-4b03-ac51-c6d6e36e003d with Priority: HIGHEST for action port [ 837.847450] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e940d90a-8ae0-4b03-ac51-c6d6e36e003d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.847450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e940d90a-8ae0-4b03-ac51-c6d6e36e003d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.847450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e940d90a-8ae0-4b03-ac51-c6d6e36e003d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.847682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e940d90a-8ae0-4b03-ac51-c6d6e36e003d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.847825] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e940d90a-8ae0-4b03-ac51-c6d6e36e003d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.350612] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e940d90a-8ae0-4b03-ac51-c6d6e36e003d [ 838.350864] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.351009] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.351089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.351367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.351440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.351551] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e940d90a-8ae0-4b03-ac51-c6d6e36e003d already deleted. [ 838.351663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e940d90a-8ae0-4b03-ac51-c6d6e36e003d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.579169] env[70032]: INFO networking_nsxv3.common.synchronization [req-14d51e63-0128-438c-bcba-fab2cd9752bd req-3ca67813-cef7-4465-b8ee-5b375ade5189 service nova] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_rules [ 838.579382] env[70032]: INFO networking_nsxv3.common.synchronization [req-14d51e63-0128-438c-bcba-fab2cd9752bd req-3ca67813-cef7-4465-b8ee-5b375ade5189 service nova] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_members [ 838.579524] env[70032]: INFO networking_nsxv3.common.synchronization [req-14d51e63-0128-438c-bcba-fab2cd9752bd req-3ca67813-cef7-4465-b8ee-5b375ade5189 service nova] Enqueued Resource ID: fb6227f8-2978-4633-b5ff-97a503859aaf with Priority: HIGHEST for action port [ 838.580041] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_rules [ 838.580200] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_members [ 838.580307] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6227f8-2978-4633-b5ff-97a503859aaf with Priority: HIGHEST for action port [ 838.580577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.580700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.580767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.580973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.581072] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.581927] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.582056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.582130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.582303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.582448] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.583105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.583105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.583105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.583105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.583105] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.583735] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6227f8-2978-4633-b5ff-97a503859aaf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.583945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.583945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.584557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.584557] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6227f8-2978-4633-b5ff-97a503859aaf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.758154] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 in Status: SUCCESS [ 838.758294] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 deletion is rescheduled due to dependency. [ 838.758599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.090173] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.090173] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.090173] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb6227f8-2978-4633-b5ff-97a503859aaf with status ACTIVE [ 839.090173] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.090173] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.090173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.090698] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.090698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.090698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.090698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.090698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.090698] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb6227f8-2978-4633-b5ff-97a503859aaf is going to be updated. [ 839.112528] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.112528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.113881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.113881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.113881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.113881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6227f8-2978-4633-b5ff-97a503859aaf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.153979] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e5684ed-a2ec-4328-bc8b-9e25a8cee58a req-d6730dfe-3154-433a-a4bc-a262232787ea tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_members [ 839.154762] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_members [ 839.154837] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.155099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.156408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.156408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.156408] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.156872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.157117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.158671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.158671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.158671] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.559995] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.559995] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.559995] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.559995] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.560707] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.560707] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.560707] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.560707] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.560707] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.560928] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.561490] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.561490] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.561490] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.561490] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.561490] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.561708] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.583688] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.583688] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.583688] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.583688] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-583" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.584991] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.585235] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.585441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.587991] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.588185] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b165f61d-d4e6-41fc-bbd2-1f457454a7c4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.593053] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.665203] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.665398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.665471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.665693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.665794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.666128] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.666214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.666214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.666373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.666454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.666556] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 already deleted. [ 839.667881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.819134] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 in Status: SUCCESS [ 839.819134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.024822] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1e9e370d-6a1e-41d5-bc9e-b336131a9df4 None None] Enqueued Resource ID: f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62 with Priority: HIGHEST for action port [ 840.024822] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62 with Priority: HIGHEST for action port [ 840.025189] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.025714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.026966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.027636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.028050] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.095029] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.095029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port b165f61d-d4e6-41fc-bbd2-1f457454a7c4 not found, creating... [ 840.095029] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.095029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.095630] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.095630] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.096540] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.099284] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.099284] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.099284] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: b165f61d-d4e6-41fc-bbd2-1f457454a7c4 is going to be created. [ 840.099284] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.099284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.099284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.100045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.100270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.100476] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f is going to be created. [ 840.123012] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.123012] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.123012] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.123012] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.123012] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.123012] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.127161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.127480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.127663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.127969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.128274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.136785] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: UNINITIALIZED for 2s [ 840.533156] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62 [ 840.533603] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.533802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.533929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.534167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.534265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.534360] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62 already deleted. [ 840.534472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f07d240e-e5e0-4bb7-9a9a-4a1f764f1e62" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.917631] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e5684ed-a2ec-4328-bc8b-9e25a8cee58a req-a4daf537-744a-493f-8824-2ba94805fd19 service nova] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_rules [ 840.917911] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e5684ed-a2ec-4328-bc8b-9e25a8cee58a req-a4daf537-744a-493f-8824-2ba94805fd19 service nova] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_members [ 840.917911] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e5684ed-a2ec-4328-bc8b-9e25a8cee58a req-a4daf537-744a-493f-8824-2ba94805fd19 service nova] Enqueued Resource ID: b165f61d-d4e6-41fc-bbd2-1f457454a7c4 with Priority: HIGHEST for action port [ 840.918087] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_rules [ 840.918210] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_members [ 840.918304] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b165f61d-d4e6-41fc-bbd2-1f457454a7c4 with Priority: HIGHEST for action port [ 840.921622] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.921823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.921904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.922130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.922216] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.923439] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.923439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.923439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.923596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.923628] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.923716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.923785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.923923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.924017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.924108] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.925472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.925582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.925660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.925802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.925887] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b165f61d-d4e6-41fc-bbd2-1f457454a7c4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.428055] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.429172] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.429284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.429447] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b165f61d-d4e6-41fc-bbd2-1f457454a7c4 with status ACTIVE [ 841.429608] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.429711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.429777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.429981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.430124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.430267] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.430373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.430420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.430609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.430648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.430846] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.430902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.430965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.431330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.431330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.431448] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b165f61d-d4e6-41fc-bbd2-1f457454a7c4 is going to be updated. [ 841.450679] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.450913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.450988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.451235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.451330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.451485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b165f61d-d4e6-41fc-bbd2-1f457454a7c4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.933422] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.147569] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: SUCCESS [ 842.147970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.148271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.148603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.149037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.150563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.150563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.150563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.150563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.150563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.150563] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.437922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.437922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.437922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.437922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.437922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.437922] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 is going to be created. [ 842.458186] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.458352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.458423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.458643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.458802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.466883] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: UNINITIALIZED for 2s [ 842.653250] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.154879] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57166f3a-68e3-48b8-984a-2376cb60573f: rpc.has_security_group_logging(os_id): False [ 843.177014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.177174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.177254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.177547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.177659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.177915] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.178024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.178086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.178250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.178331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.178420] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f is going to be created. [ 843.250042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.250167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.250266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.250435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.250584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.261867] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: IN_PROGRESS for 2s [ 844.304026] env[70032]: INFO networking_nsxv3.common.synchronization [req-a14b75c0-5bdd-4c1c-b366-6fd6cb322f9f req-97fa3e99-00bf-4b10-8a5d-a4a347f270e7 tempest-ServerPasswordTestJSON-598535803 tempest-ServerPasswordTestJSON-598535803-project-member] Enqueued Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_members [ 844.304026] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 with Priority: HIGHEST for action security_group_members [ 844.304026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2dd745-ad31-4195-9f0e-c534fa480580 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.304026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.304026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.304026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.304026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.304026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.304026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.305879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.305983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.306121] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2dd745-ad31-4195-9f0e-c534fa480580',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.330572] env[70032]: INFO networking_nsxv3.common.synchronization [req-75e14bf5-58b4-462f-b58e-07e4a14c26e8 req-47f9c9cb-0524-4787-ac64-16f8b51619ec tempest-FloatingIPsAssociationTestJSON-445852628 tempest-FloatingIPsAssociationTestJSON-445852628-project-member] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 844.331181] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGHEST for action security_group_members [ 844.331674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.331858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.331858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.332135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.332300] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.332405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.332468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.332629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.332932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.333069] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.416406] env[70032]: INFO networking_nsxv3.common.synchronization [req-02c50d17-e5fb-4c46-acec-6e8fea254b41 req-868aab3a-505e-4aea-9aa4-cc4eb7eb6ced tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 844.416406] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 844.416406] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.416406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.416406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.416406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.416406] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.416406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.416406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.416703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.416703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.416703] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.478313] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: SUCCESS [ 844.478526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.479315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.479531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.479731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.479852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.479918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.480084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.480170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.480258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.480349] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.815588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.815753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.815826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.816138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.816271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.816503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.816614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.816679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.816857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.816938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.817209] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 is going to be updated. [ 844.836139] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.836254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.836297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.836461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.842076] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.842076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.842076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.842307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.842380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.849209] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 in Status: IN_PROGRESS for 2s [ 844.856115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.856115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.856115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.856115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.856115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.856115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.856115] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be updated. [ 844.882256] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.882256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.882256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.882256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.882256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.890772] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: IN_PROGRESS for 2s [ 844.919565] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.919565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.919565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.919780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.919878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920083] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.920186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.920249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.920407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920569] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 844.967679] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.968033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.968222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.968515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.969468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.978854] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 844.983142] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.273768] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: SUCCESS [ 845.274087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.485468] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17fd7384-1e1f-4823-baff-e68bca324f40: rpc.has_security_group_logging(os_id): False [ 845.505873] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.506031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.506116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.506336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.506432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.506806] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.506806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.506948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.506982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.507058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.507143] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 is going to be created. [ 845.564982] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.565210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.565290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.565495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.565670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.575425] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: IN_PROGRESS for 2s [ 846.859321] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 in Status: SUCCESS [ 846.859321] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2dd745-ad31-4195-9f0e-c534fa480580 deletion is rescheduled due to dependency. [ 846.859321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2dd745-ad31-4195-9f0e-c534fa480580" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.899031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8359b363-4508-4e0c-909f-bfb6605cb735 in Status: SUCCESS [ 846.899031] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 deletion is rescheduled due to dependency. [ 846.899168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.990297] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 846.990549] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a deletion is rescheduled due to dependency. [ 846.990797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.587267] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: SUCCESS [ 847.588412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.416309] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 849.416309] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 850.260366] env[70032]: INFO networking_nsxv3.common.synchronization [req-f1410b08-10b0-44b8-bc65-46db3cb22537 req-d85b6975-d28a-4b1c-9b1e-71fe02edae60 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 850.260906] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 850.261842] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.261999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.262084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.262336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.262514] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.263225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.263269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.263413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.263505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.263602] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.516309] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.516622] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.516622] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.516872] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.517139] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.517301] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.517418] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.517632] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.517781] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.517997] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.518313] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.518439] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.518555] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.518671] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.518779] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.518914] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.537380] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.537563] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 850.537692] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.537857] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.538164] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-32f3e9bc-66a0-4d83-afd1-dee0454182a5 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.538332] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.538451] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.538739] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.538880] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32f3e9bc-66a0-4d83-afd1-dee0454182a5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.766118] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.766118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.766373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.766410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.766536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.766756] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.766861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.766929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.767094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.767175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.767263] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 already deleted. [ 850.767346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.041122] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.041288] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.041438] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.041714] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.041909] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.042086] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 32f3e9bc-66a0-4d83-afd1-dee0454182a5 not found, creating... [ 851.042390] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.042580] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.042714] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.042974] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.043223] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.043578] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.043748] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.043872] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.044103] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.044293] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.044443] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 32f3e9bc-66a0-4d83-afd1-dee0454182a5 is going to be created. [ 851.063642] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.063844] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.063967] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.064261] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.064500] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.064720] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.744742] env[70032]: INFO networking_nsxv3.common.synchronization [req-f1410b08-10b0-44b8-bc65-46db3cb22537 req-cb0eb342-ac0f-4ebf-929a-34fb8e07df6d service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 851.744984] env[70032]: INFO networking_nsxv3.common.synchronization [req-f1410b08-10b0-44b8-bc65-46db3cb22537 req-cb0eb342-ac0f-4ebf-929a-34fb8e07df6d service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 851.745071] env[70032]: INFO networking_nsxv3.common.synchronization [req-f1410b08-10b0-44b8-bc65-46db3cb22537 req-cb0eb342-ac0f-4ebf-929a-34fb8e07df6d service nova] Enqueued Resource ID: 32f3e9bc-66a0-4d83-afd1-dee0454182a5 with Priority: HIGHEST for action port [ 851.745326] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 851.745456] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 851.745554] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f3e9bc-66a0-4d83-afd1-dee0454182a5 with Priority: HIGHEST for action port [ 851.747245] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.748263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.748371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.748636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.748769] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.749980] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.750111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.750179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.750348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.750494] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.750587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.750649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.750787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.750883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.750970] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.751999] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-32f3e9bc-66a0-4d83-afd1-dee0454182a5 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.752124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.752190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.752337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.752413] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32f3e9bc-66a0-4d83-afd1-dee0454182a5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.254329] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.255349] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.255463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.256130] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32f3e9bc-66a0-4d83-afd1-dee0454182a5 with status ACTIVE [ 852.256130] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.256276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.256276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.256458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.256532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.256696] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.256825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.256884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.257498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.257498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.257498] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.257498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.257498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.257498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.257905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.257905] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32f3e9bc-66a0-4d83-afd1-dee0454182a5 is going to be updated. [ 852.276918] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.277068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.277125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.277311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.277444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.277597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32f3e9bc-66a0-4d83-afd1-dee0454182a5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.756461] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.259034] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.259034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.259034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.259267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.259267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.259331] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be created. [ 853.281577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.281812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.281935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.282273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.282508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.292112] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: UNINITIALIZED for 2s [ 853.376564] env[70032]: INFO networking_nsxv3.common.synchronization [req-9fbc851a-9d40-4abb-ae28-4c64ca746ff4 req-5671c980-6e91-424c-a398-e48e0b4d6ec0 tempest-ServerMetadataTestJSON-1558977330 tempest-ServerMetadataTestJSON-1558977330-project-member] Enqueued Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_members [ 853.377078] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_members [ 853.377476] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-449f8b7d-089e-4037-adbd-8e1125cab8b6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.377582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.377582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.377791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.377941] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.378094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.378238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.378314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.378397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.378488] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.653392] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.653392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-594" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.653623] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-594" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.654279] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-594" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.654561] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.654735] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.654856] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.655110] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.655944] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.655944] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.655944] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.655944] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.655944] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.655944] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.656226] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.656226] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.674187] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.674394] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.674584] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.674766] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-594" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.675080] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-fbb42ba0-0417-4448-8200-019f402d875c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.675283] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.675408] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.675844] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.675844] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb42ba0-0417-4448-8200-019f402d875c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.881542] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.881542] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.881542] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 already deleted. [ 853.881542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.178158] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.178400] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.178527] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.178800] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.178966] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.179137] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port fbb42ba0-0417-4448-8200-019f402d875c not found, creating... [ 854.179434] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.179596] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.179684] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.179975] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.180059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.180655] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.180655] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.180655] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.180941] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.180941] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.181338] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: fbb42ba0-0417-4448-8200-019f402d875c is going to be created. [ 854.203386] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.204295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.204295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.204295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.204295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.204496] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.878227] env[70032]: INFO networking_nsxv3.common.synchronization [req-9fbc851a-9d40-4abb-ae28-4c64ca746ff4 req-be90d353-208c-498b-96ac-e0f04e68bee8 service nova] Enqueued Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_rules [ 854.878227] env[70032]: INFO networking_nsxv3.common.synchronization [req-9fbc851a-9d40-4abb-ae28-4c64ca746ff4 req-be90d353-208c-498b-96ac-e0f04e68bee8 service nova] Enqueued Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_members [ 854.878227] env[70032]: INFO networking_nsxv3.common.synchronization [req-9fbc851a-9d40-4abb-ae28-4c64ca746ff4 req-be90d353-208c-498b-96ac-e0f04e68bee8 service nova] Enqueued Resource ID: fbb42ba0-0417-4448-8200-019f402d875c with Priority: HIGHEST for action port [ 854.878227] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_rules [ 854.878227] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_members [ 854.878227] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbb42ba0-0417-4448-8200-019f402d875c with Priority: HIGHEST for action port [ 854.878227] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-449f8b7d-089e-4037-adbd-8e1125cab8b6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.878227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.878227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.878762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.881476] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.882789] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-449f8b7d-089e-4037-adbd-8e1125cab8b6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.885085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.885085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.885085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.885085] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.885085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.885085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.885085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.885085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.885085] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.885841] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbb42ba0-0417-4448-8200-019f402d875c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.886779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.886779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.886779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.886779] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb42ba0-0417-4448-8200-019f402d875c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.301391] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 855.301612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.301790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.302008] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.302205] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.302323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.302397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.302546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.302627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.302711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.302800] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.383904] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-449f8b7d-089e-4037-adbd-8e1125cab8b6 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.384115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.389012] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.390847] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbb42ba0-0417-4448-8200-019f402d875c with status ACTIVE [ 855.391065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.391192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.391263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.391554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.391647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.391815] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.392068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.392068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.392170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.392206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.392369] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.392457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.392515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.392646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.392740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.394032] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbb42ba0-0417-4448-8200-019f402d875c is going to be updated. [ 855.411202] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.411347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.411417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.411652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.411790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.412023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbb42ba0-0417-4448-8200-019f402d875c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.806606] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.806766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.806839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.807065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.807219] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.807321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.807384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.807545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.807631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.807768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.807854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.807945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.808046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.808181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.808320] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.808409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.808468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.808601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.808676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.808754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.808842] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.894173] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.260103] env[70032]: INFO networking_nsxv3.common.synchronization [req-cd4807b4-10db-4180-b415-1d7b890a8333 req-9118fa98-aeed-48a1-9e22-b75a2f5636c4 tempest-ImagesNegativeTestJSON-119148529 tempest-ImagesNegativeTestJSON-119148529-project-member] Enqueued Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_members [ 856.260712] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_members [ 856.261050] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00371e37-ee75-4ff4-9639-24f7314003da taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.261393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.262496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.262821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.262821] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.262983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.263389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.263818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.264247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.265024] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.312174] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d880077d-b1e8-47fa-bc09-7da9308456b0: rpc.has_security_group_logging(os_id): False [ 856.331257] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.331768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.331768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.331985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.332136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.332360] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.332491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.332572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.332752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.332827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.333147] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.333297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.333415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.333597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.333808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.333942] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.334129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.334226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.334407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.334525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.334640] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be created. [ 856.390778] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.390778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.390778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.390778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.390778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.396253] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.401254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.401254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.401254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.401254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.401254] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 is going to be created. [ 856.401254] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 856.429015] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.429015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.430850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.430971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.431830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.441575] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 in Status: UNINITIALIZED for 2s [ 856.747800] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.747987] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-379" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.748120] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-379" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.748434] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-379" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.748689] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.748828] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.748944] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.752013] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.752306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.752530] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.752701] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.752754] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.752864] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.752976] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.753097] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.753230] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.770931] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.770931] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.770931] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00371e37-ee75-4ff4-9639-24f7314003da already deleted. [ 856.770931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.775034] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.775034] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.775034] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.775034] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-379" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.775034] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-5431a41c-34eb-4583-bf20-b571a7fbcd29 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.775034] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.775034] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.775034] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.775034] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5431a41c-34eb-4583-bf20-b571a7fbcd29',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.277188] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.277503] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.277544] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.277849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.277963] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.278153] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 5431a41c-34eb-4583-bf20-b571a7fbcd29 not found, creating... [ 857.278389] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.278615] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.278767] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.278992] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.279148] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.279432] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.279592] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.279711] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.279914] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.280069] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.280198] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 5431a41c-34eb-4583-bf20-b571a7fbcd29 is going to be created. [ 857.304316] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.304498] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.304617] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.304899] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.305142] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305411] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.255718] env[70032]: INFO networking_nsxv3.common.synchronization [req-cd4807b4-10db-4180-b415-1d7b890a8333 req-c62d3aed-1014-4616-ae96-c9fa8c26ce2b service nova] Enqueued Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_rules [ 858.255889] env[70032]: INFO networking_nsxv3.common.synchronization [req-cd4807b4-10db-4180-b415-1d7b890a8333 req-c62d3aed-1014-4616-ae96-c9fa8c26ce2b service nova] Enqueued Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_members [ 858.256037] env[70032]: INFO networking_nsxv3.common.synchronization [req-cd4807b4-10db-4180-b415-1d7b890a8333 req-c62d3aed-1014-4616-ae96-c9fa8c26ce2b service nova] Enqueued Resource ID: 5431a41c-34eb-4583-bf20-b571a7fbcd29 with Priority: HIGHEST for action port [ 858.256293] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_rules [ 858.256429] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_members [ 858.256521] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5431a41c-34eb-4583-bf20-b571a7fbcd29 with Priority: HIGHEST for action port [ 858.257143] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00371e37-ee75-4ff4-9639-24f7314003da taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.257386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.257454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.258029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.258117] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.259033] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00371e37-ee75-4ff4-9639-24f7314003da taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.259033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.259115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.259268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.259413] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.259505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.259579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.259726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.259814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.259902] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.260715] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5431a41c-34eb-4583-bf20-b571a7fbcd29 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.264084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.264725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.264725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.264725] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5431a41c-34eb-4583-bf20-b571a7fbcd29',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.412931] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 858.413261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.450386] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 in Status: SUCCESS [ 858.450599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.450755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.450965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.451160] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.451307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.451356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.451528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.451621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.451711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.451803] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.765883] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.767078] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00371e37-ee75-4ff4-9639-24f7314003da taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.767218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.767437] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5431a41c-34eb-4583-bf20-b571a7fbcd29 with status ACTIVE [ 858.767561] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.767714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.767782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.767986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.768097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.768594] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.768594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.768594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.768594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.768774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.768867] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.768942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.768990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.773105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.773195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.773740] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5431a41c-34eb-4583-bf20-b571a7fbcd29 is going to be updated. [ 858.793176] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.793349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.793399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.793770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.793854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.794040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5431a41c-34eb-4583-bf20-b571a7fbcd29" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.920211] env[70032]: INFO networking_nsxv3.common.synchronization [req-6e6495af-bdbc-49cc-ba0a-05a802d889b5 req-bfef79e2-c0fd-4536-860b-a5e764b9cb5d tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 858.920707] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 858.920994] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.921125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.921192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.921446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.921606] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.921708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.921771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.921925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.926056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.926221] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.954463] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-449f8b7d-089e-4037-adbd-8e1125cab8b6 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.954639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.954717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.954974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.955169] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.955309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.955378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.955532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.955644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.955700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.955860] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-449f8b7d-089e-4037-adbd-8e1125cab8b6 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.955991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.955991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.956154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.956326] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.956420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.956476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.956618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.956699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.956796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.956978] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.276797] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.430545] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.430842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.430842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.430971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.446413] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.447638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.447638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.447638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.447638] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.447638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.447638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.447853] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.447853] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.450493] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.450493] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.450493] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.450493] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.450493] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.450493] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.450493] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.464307] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 449f8b7d-089e-4037-adbd-8e1125cab8b6: rpc.has_security_group_logging(os_id): False [ 859.469908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.469986] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.471657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.471705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.471894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.471982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.472086] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 859.475556] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.475931] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.475931] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.476074] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.476392] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.476571] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.476693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.476981] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.477142] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.499146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.499315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.499423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.499632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.499801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.502387] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.502504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.502592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.502787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.502890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.503093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.503222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.503288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.503467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.503561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.503771] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.503884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.503943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.506221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.506333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.506527] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.506626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.506701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.506828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.506892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.506984] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 is going to be created. [ 859.515374] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 859.564908] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.565075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.565150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.565547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.565630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.575157] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 in Status: IN_PROGRESS for 2s [ 859.779420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.779590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.779662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.779876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.779969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.780084] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00371e37-ee75-4ff4-9639-24f7314003da is going to be created. [ 859.803316] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.803460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.803533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.803731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.803889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.813408] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00371e37-ee75-4ff4-9639-24f7314003da in Status: UNINITIALIZED for 2s [ 859.979861] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.980112] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.980279] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.980581] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.980772] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.980935] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c not found, creating... [ 859.981231] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.981406] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.981526] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.981810] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.982267] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.982669] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.982854] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.982979] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.983825] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.983971] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.984266] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c is going to be created. [ 860.003058] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.003312] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.003446] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.004209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.004209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.004209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.304082] env[70032]: INFO networking_nsxv3.common.synchronization [req-6e6495af-bdbc-49cc-ba0a-05a802d889b5 req-f0fb19aa-695d-4070-ba60-018bb1647525 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 861.304082] env[70032]: INFO networking_nsxv3.common.synchronization [req-6e6495af-bdbc-49cc-ba0a-05a802d889b5 req-f0fb19aa-695d-4070-ba60-018bb1647525 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 861.304082] env[70032]: INFO networking_nsxv3.common.synchronization [req-6e6495af-bdbc-49cc-ba0a-05a802d889b5 req-f0fb19aa-695d-4070-ba60-018bb1647525 service nova] Enqueued Resource ID: ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c with Priority: HIGHEST for action port [ 861.304082] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 861.304082] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 861.304082] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c with Priority: HIGHEST for action port [ 861.304772] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.304772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.304772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.304772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.304772] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.306312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.306312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.306312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.306312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.306312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.306312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.306724] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.525486] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 861.527534] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 861.527534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.527534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.527534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.527534] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.527534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.527534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.527534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.527534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.527534] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.589699] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 in Status: SUCCESS [ 861.589699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.624276] env[70032]: INFO networking_nsxv3.common.synchronization [req-2340b584-f242-458b-afb4-6753cbe5f148 req-8a63a2be-442f-4b82-867d-ea62d3937827 tempest-VolumesAdminNegativeTest-1559699096 tempest-VolumesAdminNegativeTest-1559699096-project-member] Enqueued Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_members [ 861.624276] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_members [ 861.624276] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b9cad3-7556-42c3-8caf-441973387e39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.624276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.624276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.624845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.625312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.626950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.626950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.626950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.626950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.626950] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.810394] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c with status ACTIVE [ 861.810594] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.810805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.810921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.811111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.811225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.812287] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.812287] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.812287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.812789] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c is going to be updated. [ 861.814322] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.814322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.822159] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00371e37-ee75-4ff4-9639-24f7314003da in Status: SUCCESS [ 861.822254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.822341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.822542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.822727] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.823032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.823032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.823132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.823670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.823670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.823670] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.833345] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.833497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.833587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.833830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.834041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.834253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae7fdd8d-fa88-40be-b448-9c1d5b8ad73c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.030185] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.082555] env[70032]: INFO networking_nsxv3.common.synchronization [None req-10046e4c-2986-40eb-8b47-3d6d2fce8447 None None] Enqueued Resource ID: f6cbf045-f6d2-4c71-a0f5-c3b665e9753f with Priority: HIGHEST for action port [ 862.082814] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6cbf045-f6d2-4c71-a0f5-c3b665e9753f with Priority: HIGHEST for action port [ 862.083429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6cbf045-f6d2-4c71-a0f5-c3b665e9753f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.083616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6cbf045-f6d2-4c71-a0f5-c3b665e9753f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.083616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6cbf045-f6d2-4c71-a0f5-c3b665e9753f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.083873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6cbf045-f6d2-4c71-a0f5-c3b665e9753f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.083955] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6cbf045-f6d2-4c71-a0f5-c3b665e9753f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.128337] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.128720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.128912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.130264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.130264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.130264] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.130264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.130264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.130264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.130264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.130264] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b9cad3-7556-42c3-8caf-441973387e39 already deleted. [ 862.130264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.292836] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.292979] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.293102] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.293462] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.293733] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.293909] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.294014] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.294587] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.294771] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.294997] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.295132] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.295282] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.295406] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.295525] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.295645] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.295819] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.316704] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.317059] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.317059] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.320242] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.320242] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.320242] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.320242] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.320242] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.320242] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d864e4-4ea3-41fd-93b3-b5f6c52d6585',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.327016] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00371e37-ee75-4ff4-9639-24f7314003da taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.327155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.327223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.327444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.327621] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.327720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.327781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.327938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.328035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.328117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.328290] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00371e37-ee75-4ff4-9639-24f7314003da taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.328384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.328441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.328595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.328726] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.328823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.328882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.329706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.329849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.329941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.330059] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.533313] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.589026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6cbf045-f6d2-4c71-a0f5-c3b665e9753f [ 862.589026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.589026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.589026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.589026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.589026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.589026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6cbf045-f6d2-4c71-a0f5-c3b665e9753f already deleted. [ 862.589026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6cbf045-f6d2-4c71-a0f5-c3b665e9753f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.828216] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.828216] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.828216] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.828216] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.828216] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.828216] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 55d864e4-4ea3-41fd-93b3-b5f6c52d6585 not found, creating... [ 862.828762] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.828762] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.828762] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.828762] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.828912] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.829150] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.829310] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.829428] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.829635] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.829771] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.829910] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 55d864e4-4ea3-41fd-93b3-b5f6c52d6585 is going to be created. [ 862.831707] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00371e37-ee75-4ff4-9639-24f7314003da: rpc.has_security_group_logging(os_id): False [ 862.853353] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.853353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.853577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.853636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.853733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.853899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.853998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.854067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.854200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.854283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.854469] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.854587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.854659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.854744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.854814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.854994] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.855113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.855174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.858693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.858693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.858693] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00371e37-ee75-4ff4-9639-24f7314003da is going to be created. [ 862.858693] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.858693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.858693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.858693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.858693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.858693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.923144] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.925453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.925453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.925453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.925453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.940259] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00371e37-ee75-4ff4-9639-24f7314003da in Status: IN_PROGRESS for 2s [ 863.038342] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.038342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.038342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.038342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.038342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.038862] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 863.071277] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.071277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.071277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.071277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.071277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.078029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 863.695589] env[70032]: INFO networking_nsxv3.common.synchronization [req-90772b27-bab1-454a-81af-e6a93e508797 req-115bb102-6105-4053-8fc7-3d68ebde4704 tempest-ServersTestJSON-1822060144 tempest-ServersTestJSON-1822060144-project-member] Enqueued Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_members [ 863.696205] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGHEST for action security_group_members [ 863.696463] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.696538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.696601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.696803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.700616] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.700743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.700808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.700981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.701136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.701312] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.705047] env[70032]: INFO networking_nsxv3.common.synchronization [req-d503bfbf-81d3-43f0-abe5-63545e639e3e req-6d1db6ad-9b15-4c4b-8e2f-e960bec83862 tempest-ServersTestFqdnHostnames-1197439368 tempest-ServersTestFqdnHostnames-1197439368-project-member] Enqueued Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_members [ 863.705047] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20098c3-4944-4612-af2a-f2d01874388d with Priority: HIGHEST for action security_group_members [ 863.705182] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b20098c3-4944-4612-af2a-f2d01874388d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.705326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.706050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.706050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.706050] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.706050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.706050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.706488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.706488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.706488] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b20098c3-4944-4612-af2a-f2d01874388d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.026941] env[70032]: INFO networking_nsxv3.common.synchronization [req-2340b584-f242-458b-afb4-6753cbe5f148 req-b2166bb3-cbaf-490c-bd77-b23173ae80e5 service nova] Enqueued Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_rules [ 864.026941] env[70032]: INFO networking_nsxv3.common.synchronization [req-2340b584-f242-458b-afb4-6753cbe5f148 req-b2166bb3-cbaf-490c-bd77-b23173ae80e5 service nova] Enqueued Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_members [ 864.026941] env[70032]: INFO networking_nsxv3.common.synchronization [req-2340b584-f242-458b-afb4-6753cbe5f148 req-b2166bb3-cbaf-490c-bd77-b23173ae80e5 service nova] Enqueued Resource ID: 55d864e4-4ea3-41fd-93b3-b5f6c52d6585 with Priority: HIGHEST for action port [ 864.031134] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_rules [ 864.031134] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_members [ 864.031134] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d864e4-4ea3-41fd-93b3-b5f6c52d6585 with Priority: HIGHEST for action port [ 864.031134] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b9cad3-7556-42c3-8caf-441973387e39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.031134] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.031134] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b9cad3-7556-42c3-8caf-441973387e39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.031134] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.031134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.031134] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.032344] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.032479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.032580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.032734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.032944] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d864e4-4ea3-41fd-93b3-b5f6c52d6585',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.168744] env[70032]: INFO networking_nsxv3.common.synchronization [None req-a8a821c6-69a4-41ba-90c6-4f6c4e59277b None None] Enqueued Resource ID: d3acd2dc-18c1-419c-abf8-4f67213de1b0 with Priority: HIGHEST for action port [ 864.169135] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3acd2dc-18c1-419c-abf8-4f67213de1b0 with Priority: HIGHEST for action port [ 864.169565] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3acd2dc-18c1-419c-abf8-4f67213de1b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.169692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3acd2dc-18c1-419c-abf8-4f67213de1b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.169752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3acd2dc-18c1-419c-abf8-4f67213de1b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.171973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3acd2dc-18c1-419c-abf8-4f67213de1b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.171973] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3acd2dc-18c1-419c-abf8-4f67213de1b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.204010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.204257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.204257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.204441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.208747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.208747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.227020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.227020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 is going to be updated. [ 864.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.250826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.250826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.250826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.250826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.250826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.254916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.255792] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.257535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.257535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.257535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.257535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.257535] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20098c3-4944-4612-af2a-f2d01874388d is going to be updated. [ 864.264893] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 in Status: IN_PROGRESS for 2s [ 864.279128] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.279128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.279326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.280088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.280088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.287249] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20098c3-4944-4612-af2a-f2d01874388d in Status: IN_PROGRESS for 2s [ 864.356408] env[70032]: INFO networking_nsxv3.common.synchronization [req-256e3bb3-71e8-4b53-bf01-8f38b428a62a req-4b29884a-fdd2-4cea-b69b-54ece53fe978 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 864.357152] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 864.357347] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.357448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.357529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.357728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.358367] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.358367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.358367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.358367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.358367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.358367] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.534111] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b9cad3-7556-42c3-8caf-441973387e39 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.534258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.536781] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.541260] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55d864e4-4ea3-41fd-93b3-b5f6c52d6585 with status ACTIVE [ 864.541475] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.541599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.541666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.542407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.542407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.542407] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.542407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.542407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.542636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.542636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.542693] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.542780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.542834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.542976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.543070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.543154] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55d864e4-4ea3-41fd-93b3-b5f6c52d6585 is going to be updated. [ 864.562855] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.563043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.563102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.563281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.563412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.563570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55d864e4-4ea3-41fd-93b3-b5f6c52d6585" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.672946] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3acd2dc-18c1-419c-abf8-4f67213de1b0 [ 864.673363] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.673519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.673583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.673950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.673950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.674155] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3acd2dc-18c1-419c-abf8-4f67213de1b0 already deleted. [ 864.674155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3acd2dc-18c1-419c-abf8-4f67213de1b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.860605] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.860876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.860876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.861180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.861180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.861340] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.861470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.861516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.861658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.861734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.861859] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 864.894852] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.895068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.895181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.895402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.897044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.905306] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 864.954799] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00371e37-ee75-4ff4-9639-24f7314003da in Status: SUCCESS [ 864.955035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.037316] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.088198] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 865.088424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.088588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.088804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.088997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.089128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.089196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.089345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.089430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.089514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.089603] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.542827] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.542827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.542827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.542827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.542827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.542827] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b9cad3-7556-42c3-8caf-441973387e39 is going to be created. [ 865.566854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.567332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.568136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.568136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.570127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.578625] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b9cad3-7556-42c3-8caf-441973387e39 in Status: UNINITIALIZED for 2s [ 865.595588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.595588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.595588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.595588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.595588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.596400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.596400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.596400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.596400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.596400] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.755721] env[70032]: INFO networking_nsxv3.common.synchronization [None req-7a5fc5af-8531-4553-bbb1-4eebf18f2128 None None] Enqueued Resource ID: 6a96ba91-027b-4096-8bb0-3f1f9759a18c with Priority: HIGHEST for action port [ 865.756597] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a96ba91-027b-4096-8bb0-3f1f9759a18c with Priority: HIGHEST for action port [ 865.757154] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a96ba91-027b-4096-8bb0-3f1f9759a18c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.757631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a96ba91-027b-4096-8bb0-3f1f9759a18c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.757841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a96ba91-027b-4096-8bb0-3f1f9759a18c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.759353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a96ba91-027b-4096-8bb0-3f1f9759a18c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.759353] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a96ba91-027b-4096-8bb0-3f1f9759a18c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.098684] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac44685-7555-444d-b1ce-19ece671a825: rpc.has_security_group_logging(os_id): False [ 866.118527] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.118527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.118527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.120208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.120460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.121070] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.121070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.121070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.121070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.121524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.121787] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.121909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.121998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.122686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.122686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.122686] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.122686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.122686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.122899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.122899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.123043] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 866.219930] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.220174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.220252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.220581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.220804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.246722] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 866.261678] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a96ba91-027b-4096-8bb0-3f1f9759a18c [ 866.261765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.261856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.261913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.262264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.262364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.262502] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a96ba91-027b-4096-8bb0-3f1f9759a18c already deleted. [ 866.262553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a96ba91-027b-4096-8bb0-3f1f9759a18c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.277475] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 in Status: SUCCESS [ 866.277475] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 deletion is rescheduled due to dependency. [ 866.277475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.300076] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b20098c3-4944-4612-af2a-f2d01874388d in Status: SUCCESS [ 866.300279] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b20098c3-4944-4612-af2a-f2d01874388d deletion is rescheduled due to dependency. [ 866.300393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b20098c3-4944-4612-af2a-f2d01874388d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.920016] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 866.920016] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 deletion is rescheduled due to dependency. [ 866.920016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.589335] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b9cad3-7556-42c3-8caf-441973387e39 in Status: SUCCESS [ 867.589656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.589728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.589925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.590138] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.590272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.590344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.590606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.590743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.590743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.590849] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.857167] env[70032]: INFO networking_nsxv3.common.synchronization [req-e35811c7-c768-4c07-959d-4b91fec87405 req-29519b21-5768-4c64-a0dd-3e61f2cedbc9 tempest-InstanceActionsNegativeTestJSON-1514131944 tempest-InstanceActionsNegativeTestJSON-1514131944-project-member] Enqueued Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_members [ 867.857872] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_members [ 867.858361] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.858361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.858361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.858609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.858737] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.858837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.858897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.859063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.859151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.859536] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.096789] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.260789] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 868.261222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.350958] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8ce515c2-c172-4df2-9f09-fd8fcfd8052d None None] Enqueued Resource ID: 4254cad3-4864-4e56-a625-484ce015b911 with Priority: HIGHEST for action port [ 868.352559] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4254cad3-4864-4e56-a625-484ce015b911 with Priority: HIGHEST for action port [ 868.353077] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4254cad3-4864-4e56-a625-484ce015b911 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.353374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4254cad3-4864-4e56-a625-484ce015b911" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.353540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4254cad3-4864-4e56-a625-484ce015b911" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.353903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4254cad3-4864-4e56-a625-484ce015b911" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.354109] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4254cad3-4864-4e56-a625-484ce015b911',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.365380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.365380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.365380] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa already deleted. [ 868.365380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.380341] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.380540] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-226" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.380706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-226" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.381016] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-226" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.381245] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.381402] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.381838] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.381838] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.381963] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.382120] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.382189] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.382298] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.382406] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.382511] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.382616] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.382749] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.400999] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.401187] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.401328] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.401494] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-226" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.401789] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.401958] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.402090] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.402436] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.402537] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f9c871-0b1a-4816-a0ed-fd0e134ee209',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.600788] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00b9cad3-7556-42c3-8caf-441973387e39: rpc.has_security_group_logging(os_id): False [ 868.616708] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.616856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.616918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.617147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.618513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.618513] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.618513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.618513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.618513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.618513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.618513] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b9cad3-7556-42c3-8caf-441973387e39 is going to be created. [ 868.673046] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.673172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.673172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.673382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.673783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.684485] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b9cad3-7556-42c3-8caf-441973387e39 in Status: IN_PROGRESS for 2s [ 868.792943] env[70032]: INFO networking_nsxv3.common.synchronization [req-0859fd4b-ca59-4049-b516-d18320932026 req-8c30d2a5-3b58-45c3-830a-d47f723b1ba0 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_members [ 868.795534] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGHEST for action security_group_members [ 868.795849] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.795971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.796052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.796262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.796451] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.796528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.796589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.796739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.796825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.796917] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.856548] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4254cad3-4864-4e56-a625-484ce015b911 [ 868.856778] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.857517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.857517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.857517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.857517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.857517] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4254cad3-4864-4e56-a625-484ce015b911 already deleted. [ 868.857517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4254cad3-4864-4e56-a625-484ce015b911" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.905329] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.905329] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.905329] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.905546] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.906664] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.906664] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port d3f9c871-0b1a-4816-a0ed-fd0e134ee209 not found, creating... [ 868.906664] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.906664] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.906664] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.907112] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.907112] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.907377] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.907626] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.907782] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.908045] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.908229] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.908409] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: d3f9c871-0b1a-4816-a0ed-fd0e134ee209 is going to be created. [ 868.928614] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.929923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.929923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.930501] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.934348] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.934637] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.300824] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.300824] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.300824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.300824] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 is going to be updated. [ 869.326962] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.327132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.327209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.327514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.327689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.335748] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 in Status: IN_PROGRESS for 2s [ 869.695467] env[70032]: INFO networking_nsxv3.common.synchronization [req-e35811c7-c768-4c07-959d-4b91fec87405 req-2a3d0efb-fd1a-4cac-9a0e-6244a51b0d6e service nova] Enqueued Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_rules [ 869.695733] env[70032]: INFO networking_nsxv3.common.synchronization [req-e35811c7-c768-4c07-959d-4b91fec87405 req-2a3d0efb-fd1a-4cac-9a0e-6244a51b0d6e service nova] Enqueued Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_members [ 869.695776] env[70032]: INFO networking_nsxv3.common.synchronization [req-e35811c7-c768-4c07-959d-4b91fec87405 req-2a3d0efb-fd1a-4cac-9a0e-6244a51b0d6e service nova] Enqueued Resource ID: d3f9c871-0b1a-4816-a0ed-fd0e134ee209 with Priority: HIGHEST for action port [ 869.696017] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_rules [ 869.696168] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_members [ 869.696264] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f9c871-0b1a-4816-a0ed-fd0e134ee209 with Priority: HIGHEST for action port [ 869.696885] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.697043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.697086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.697332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.697418] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.698317] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.698398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.698450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.698628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.698773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.698869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.698930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.699085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.699171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.699259] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.700012] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.700126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.700195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.700538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.700538] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f9c871-0b1a-4816-a0ed-fd0e134ee209',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.202231] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.202339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.202534] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.203468] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3f9c871-0b1a-4816-a0ed-fd0e134ee209 with status ACTIVE [ 870.203800] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.203921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.203986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.204205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.204293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.204558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.204558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.204719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.204824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.204903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.205128] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.205216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.205279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.205471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.205563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.205635] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3f9c871-0b1a-4816-a0ed-fd0e134ee209 is going to be updated. [ 870.225969] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.226206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.226206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.226416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.226565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.226734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3f9c871-0b1a-4816-a0ed-fd0e134ee209" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.371538] env[70032]: INFO networking_nsxv3.common.synchronization [req-abf51314-91fd-41d7-b6bd-91ba41486152 req-3127d367-ebc2-4abb-bfba-69ab244be5f7 tempest-ImagesNegativeTestJSON-119148529 tempest-ImagesNegativeTestJSON-119148529-project-member] Enqueued Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_members [ 870.372215] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00371e37-ee75-4ff4-9639-24f7314003da with Priority: HIGHEST for action security_group_members [ 870.372639] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00371e37-ee75-4ff4-9639-24f7314003da taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.372832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.372946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.373210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.373429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.373602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.373703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.373952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.374302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.374302] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00371e37-ee75-4ff4-9639-24f7314003da',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.525129] env[70032]: INFO networking_nsxv3.common.synchronization [req-1cce3c81-fdc4-4826-b58b-611278e2d4eb req-455580c5-0279-4707-90f6-e8d833c9db2f tempest-ServersTestManualDisk-805921895 tempest-ServersTestManualDisk-805921895-project-member] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_members [ 870.527040] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_members [ 870.527040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.527040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.527040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.527040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.527040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.527040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.527040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.527040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.527426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.527426] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.696570] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b9cad3-7556-42c3-8caf-441973387e39 in Status: SUCCESS [ 870.696916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.707450] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.876422] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.876519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.876589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.876813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.876992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.877115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.877886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.877886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.877886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.877886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.877886] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00371e37-ee75-4ff4-9639-24f7314003da is going to be updated. [ 870.914381] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.914581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.914698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.914886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.915017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.923559] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00371e37-ee75-4ff4-9639-24f7314003da in Status: IN_PROGRESS for 2s [ 871.032429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.032429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.032429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.032429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.032634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.032683] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.032783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.032875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.032992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.033083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.034156] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 already deleted. [ 871.034289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.210148] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.210340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.210395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.210604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.210701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.210834] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa is going to be created. [ 871.236793] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.236912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.237032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.237195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.237362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.245989] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa in Status: UNINITIALIZED for 2s [ 871.330443] env[70032]: INFO networking_nsxv3.common.synchronization [req-c534691e-436c-4aba-a344-faee610a37bf req-c33fddbc-8d6e-4b4b-a06c-17de33762645 tempest-ServerMetadataTestJSON-1558977330 tempest-ServerMetadataTestJSON-1558977330-project-member] Enqueued Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_members [ 871.330972] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 with Priority: HIGHEST for action security_group_members [ 871.331286] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-449f8b7d-089e-4037-adbd-8e1125cab8b6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.331396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.331469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.331717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.331863] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.331967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.331967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.332254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.332344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.332441] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('449f8b7d-089e-4037-adbd-8e1125cab8b6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.345661] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 in Status: SUCCESS [ 871.346112] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 deletion is rescheduled due to dependency. [ 871.346112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.483927] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.483927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-404" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.483927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-404" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.483927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-404" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.488071] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.488071] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.488071] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.490653] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.490856] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.491104] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.491225] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.491339] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.491450] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.491562] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.491673] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.492047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.509358] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.509535] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 871.509672] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.509842] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-404" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.510166] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-e47c594a-03ea-469f-af7b-b04d2d1e1361 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.510326] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.510493] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.510744] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.510875] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47c594a-03ea-469f-af7b-b04d2d1e1361',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.710828] env[70032]: INFO networking_nsxv3.common.synchronization [req-7981af0d-852d-4ee1-8749-e11aee7310bf req-e30b5328-97b2-427c-8545-cd750142d0c0 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 871.711499] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 871.711685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.711851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.711905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.712152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.712299] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.712413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.712476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.712629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.712741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.712799] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.737758] env[70032]: INFO networking_nsxv3.common.synchronization [req-7981af0d-852d-4ee1-8749-e11aee7310bf req-e30b5328-97b2-427c-8545-cd750142d0c0 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 871.737937] env[70032]: INFO networking_nsxv3.common.synchronization [req-7981af0d-852d-4ee1-8749-e11aee7310bf req-e30b5328-97b2-427c-8545-cd750142d0c0 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 871.738096] env[70032]: INFO networking_nsxv3.common.synchronization [req-7981af0d-852d-4ee1-8749-e11aee7310bf req-e30b5328-97b2-427c-8545-cd750142d0c0 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 with Priority: HIGHEST for action port [ 871.738565] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 871.738694] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 871.738790] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 with Priority: HIGHEST for action port [ 871.739223] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.739373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.739446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.739639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.739720] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.740519] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.740622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.740937] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd274843-22d2-4393-9ea8-b08f21e6f4d6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.741058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.741126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.741290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.741366] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd274843-22d2-4393-9ea8-b08f21e6f4d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.834822] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.834980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.835066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.835274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.835393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.835650] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.835815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.836394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.836394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.836394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.836394] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 is going to be updated. [ 871.862261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.862427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.862495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.862685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.862898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.872110] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 in Status: IN_PROGRESS for 2s [ 872.017023] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.017023] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port e47c594a-03ea-469f-af7b-b04d2d1e1361 not found, creating... [ 872.017023] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.017023] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.017466] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.017466] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.017466] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.017466] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.017466] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.017466] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: e47c594a-03ea-469f-af7b-b04d2d1e1361 is going to be created. [ 872.039341] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.039341] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.039341] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.039341] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.039341] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.039341] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.216497] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.243157] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.243399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.247386] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd274843-22d2-4393-9ea8-b08f21e6f4d6 with status ACTIVE [ 872.247713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.248867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.248867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.248867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.248867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.248867] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.248867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.248867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.248867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.249283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.249590] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.249844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.250096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.250326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.250498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.250683] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 is going to be updated. [ 872.271270] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.271270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.271270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.271616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.271931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.271931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.597974] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 872.598202] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:1 started [ 872.718588] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.900770] env[70032]: INFO networking_nsxv3.common.synchronization [req-1cce3c81-fdc4-4826-b58b-611278e2d4eb req-4fb1d52e-83c1-4cce-8a34-adef7ef5c847 service nova] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_rules [ 872.900770] env[70032]: INFO networking_nsxv3.common.synchronization [req-1cce3c81-fdc4-4826-b58b-611278e2d4eb req-4fb1d52e-83c1-4cce-8a34-adef7ef5c847 service nova] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_members [ 872.900770] env[70032]: INFO networking_nsxv3.common.synchronization [req-1cce3c81-fdc4-4826-b58b-611278e2d4eb req-4fb1d52e-83c1-4cce-8a34-adef7ef5c847 service nova] Enqueued Resource ID: e47c594a-03ea-469f-af7b-b04d2d1e1361 with Priority: HIGHEST for action port [ 872.901115] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_rules [ 872.902452] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_members [ 872.902452] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e47c594a-03ea-469f-af7b-b04d2d1e1361 with Priority: HIGHEST for action port [ 872.902452] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.902452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.902452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.902452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.902452] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.903721] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.903721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.903721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.903721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.903721] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.903721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.904077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.904077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.904077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.904308] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.905028] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e47c594a-03ea-469f-af7b-b04d2d1e1361 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.905028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.905190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.905278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.905380] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47c594a-03ea-469f-af7b-b04d2d1e1361',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.933732] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00371e37-ee75-4ff4-9639-24f7314003da in Status: SUCCESS [ 872.933842] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00371e37-ee75-4ff4-9639-24f7314003da deletion is rescheduled due to dependency. [ 872.933887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00371e37-ee75-4ff4-9639-24f7314003da" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.122198] env[70032]: INFO networking_nsxv3.common.synchronization [req-2a2ef40a-e252-4491-adb0-735002b66415 req-3a953251-393b-42f9-8de4-196aff6686a1 tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 873.122782] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 873.124675] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.124821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.124869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.125085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.125256] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.125455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.125519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.125686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.125778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.125873] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.220616] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.220790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.220790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.221018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.221120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.221224] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be updated. [ 873.247955] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.248134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.248189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.248392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.248596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.259140] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa in Status: SUCCESS [ 873.259351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.260060] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 873.260543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.260771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.260949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.261079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.261143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.261292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.261373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.261457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.261545] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.408495] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.408876] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.409172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.409172] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e47c594a-03ea-469f-af7b-b04d2d1e1361 with status ACTIVE [ 873.410108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.410108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.410108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.410108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.410108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.410108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.410108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.410108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.411112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.411112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.411112] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.411112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.411112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.411112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.411112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.411112] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e47c594a-03ea-469f-af7b-b04d2d1e1361 is going to be updated. [ 873.435312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.435312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.435312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.435312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.435312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.435312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e47c594a-03ea-469f-af7b-b04d2d1e1361" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.630801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.630998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.631084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.631361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.651843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.652127] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.652247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.652333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.652942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.652942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.652942] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be updated. [ 873.678038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.678038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.678038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.678264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.678403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.687458] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 873.764759] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.764759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.764759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.764759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.765158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.765158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.765240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.765422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.765517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.765618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.765761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.765863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.765991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.766076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.766208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.766304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.766375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.766517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.766681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.766681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.766765] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.812553] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.812742] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.812862] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.813634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.813634] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.813634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.813833] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.813870] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.813993] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.814328] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.814444] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.814555] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.814672] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.814785] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.814892] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.815039] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.834174] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.834355] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 873.834497] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.834665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.834957] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-650c095b-db82-4d68-bebf-b31a3913431c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.835138] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.835258] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.835574] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.835713] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('650c095b-db82-4d68-bebf-b31a3913431c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.881240] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 in Status: SUCCESS [ 873.881387] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 449f8b7d-089e-4037-adbd-8e1125cab8b6 deletion is rescheduled due to dependency. [ 873.881778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-449f8b7d-089e-4037-adbd-8e1125cab8b6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.915034] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.271145] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa: rpc.has_security_group_logging(os_id): False [ 874.290840] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.290990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.291076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.291298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.291435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.291870] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.292053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.292123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.292283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.292374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.292597] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.292700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.292773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.292920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.292995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.293183] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.293276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.293325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.293468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.293545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.293634] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa is going to be created. [ 874.338641] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.338932] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.339091] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.339362] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.339518] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.339674] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 650c095b-db82-4d68-bebf-b31a3913431c not found, creating... [ 874.339933] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.340101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.340217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.340634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.340634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.340947] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.341133] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.341252] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.341460] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.341598] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.341735] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 650c095b-db82-4d68-bebf-b31a3913431c is going to be created. [ 874.359942] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.360585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.360585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.360585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.360585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.370812] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.371169] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.371310] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.371669] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.373577] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.373577] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.374425] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa in Status: IN_PROGRESS for 2s [ 874.416458] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.416775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.416939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.417269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.418179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.418179] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 is going to be created. [ 874.474236] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.474432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.474496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.474668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.474824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.487815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: UNINITIALIZED for 2s [ 875.271140] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 875.271469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.271667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.271953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.272201] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.272413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.272457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.272639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.272758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.272880] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.353684] env[70032]: INFO networking_nsxv3.common.synchronization [req-2a2ef40a-e252-4491-adb0-735002b66415 req-950b6501-f787-45b0-ac8f-e5b0bfdcc241 service nova] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_rules [ 875.353850] env[70032]: INFO networking_nsxv3.common.synchronization [req-2a2ef40a-e252-4491-adb0-735002b66415 req-950b6501-f787-45b0-ac8f-e5b0bfdcc241 service nova] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 875.353982] env[70032]: INFO networking_nsxv3.common.synchronization [req-2a2ef40a-e252-4491-adb0-735002b66415 req-950b6501-f787-45b0-ac8f-e5b0bfdcc241 service nova] Enqueued Resource ID: 650c095b-db82-4d68-bebf-b31a3913431c with Priority: HIGHEST for action port [ 875.354721] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_rules [ 875.354721] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 875.354721] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650c095b-db82-4d68-bebf-b31a3913431c with Priority: HIGHEST for action port [ 875.355822] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.355822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.355822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.355822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.355822] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.361911] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.361911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.361911] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-650c095b-db82-4d68-bebf-b31a3913431c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.361911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.361911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.361911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.361911] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('650c095b-db82-4d68-bebf-b31a3913431c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.698624] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 875.698848] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae deletion is rescheduled due to dependency. [ 875.698975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.699154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.699387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.699567] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.699677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.699739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.699950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.700054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.700162] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.776076] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.858933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.859072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.862470] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 650c095b-db82-4d68-bebf-b31a3913431c with status ACTIVE [ 875.862899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.862899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.862899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.863089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.863160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.863429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.863429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.863544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.863679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.864135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.864135] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.864673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.864780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.864948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.866725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.866725] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 650c095b-db82-4d68-bebf-b31a3913431c is going to be updated. [ 875.891301] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.891894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.891894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.891894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.892200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.892200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-650c095b-db82-4d68-bebf-b31a3913431c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.202636] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.218749] env[70032]: INFO networking_nsxv3.common.synchronization [req-fe6798b9-cf06-4cf5-84c1-3f178d153d71 req-67dc28b0-b33c-433c-a0e6-762cef6f191c tempest-MigrationsAdminTest-411767673 tempest-MigrationsAdminTest-411767673-project-member] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 876.219269] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 876.219585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.219712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.220034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.221628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.221885] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.221944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.222087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.227886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.227886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.227886] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.280852] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.390683] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa in Status: SUCCESS [ 876.391053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.497264] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: SUCCESS [ 876.497502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.497722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.497987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.498713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.499038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.499163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.499338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.499428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.499519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.499639] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.708568] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.731738] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.783913] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.784250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.784467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.784716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.784831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.785010] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be updated. [ 876.814988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.814988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.815369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.815541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.815798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.828927] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 877.006029] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.211671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.212155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.212295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.212505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.213022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.213022] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be updated. [ 877.236245] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.262196] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.262356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.262415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.262627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.262772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.273144] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 877.278116] env[70032]: INFO networking_nsxv3.common.synchronization [req-38eaae7c-1caf-405f-8307-4efbfb02667a req-01060587-0c0c-4951-9424-b7f2a911cc03 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 877.278659] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 877.279888] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.280016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.301727] env[70032]: INFO networking_nsxv3.common.synchronization [req-38eaae7c-1caf-405f-8307-4efbfb02667a req-01060587-0c0c-4951-9424-b7f2a911cc03 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 877.301727] env[70032]: INFO networking_nsxv3.common.synchronization [req-38eaae7c-1caf-405f-8307-4efbfb02667a req-01060587-0c0c-4951-9424-b7f2a911cc03 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 877.303352] env[70032]: INFO networking_nsxv3.common.synchronization [req-38eaae7c-1caf-405f-8307-4efbfb02667a req-01060587-0c0c-4951-9424-b7f2a911cc03 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 with Priority: HIGHEST for action port [ 877.303352] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_rules [ 877.303352] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 877.303352] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 with Priority: HIGHEST for action port [ 877.304046] env[70032]: INFO networking_nsxv3.common.synchronization [req-b006f15b-35df-47fc-ba19-4939718016b3 req-d618e4c2-73ed-4953-90cb-d7a15196c91e tempest-ListServersNegativeTestJSON-226060042 tempest-ListServersNegativeTestJSON-226060042-project-member] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 877.304389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.304503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.304692] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.304775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.304951] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd274843-22d2-4393-9ea8-b08f21e6f4d6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.305065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.305129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.305323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.305425] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd274843-22d2-4393-9ea8-b08f21e6f4d6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.306397] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 877.307035] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.307150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.307214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.307390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.307540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.307664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.307767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.311430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.311430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.311430] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.454818] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.455258] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.455586] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.456113] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.456711] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.456903] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.457252] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.457747] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.458039] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.459968] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.459968] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.459968] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.459968] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.459968] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.459968] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.460344] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.479681] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.480020] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 877.480281] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.480573] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.481096] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-acd661e5-50d1-40d8-9ab2-883096c92f48 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.481569] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.485022] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.485022] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.485022] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd661e5-50d1-40d8-9ab2-883096c92f48',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.505137] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14c7722e-02ea-467c-af4c-394e1f839b23: rpc.has_security_group_logging(os_id): False [ 877.521497] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.521653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.521845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.521943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.522026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.522262] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.522363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.522427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.522699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.522699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.522799] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 is going to be created. [ 877.586725] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.586725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.586725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.586725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.586725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.602385] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: IN_PROGRESS for 2s [ 877.679184] env[70032]: INFO networking_nsxv3.common.synchronization [req-6eb1a04e-e8d8-4825-901e-aa5ae9f01951 req-54fa6109-2b59-4af7-895e-30ce996c07df tempest-ListServersNegativeTestJSON-226060042 tempest-ListServersNegativeTestJSON-226060042-project-member] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 877.679184] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGHEST for action security_group_members [ 877.679184] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.679184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.744309] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.744309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.744309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.744309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.744309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.744309] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be updated. [ 877.777027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.777027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.777027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.777027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.777027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.785769] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: IN_PROGRESS for 2s [ 877.810332] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd274843-22d2-4393-9ea8-b08f21e6f4d6 with status ACTIVE [ 877.810332] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.810332] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.810332] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.810332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.810332] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd274843-22d2-4393-9ea8-b08f21e6f4d6 is going to be updated. [ 877.813241] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.831294] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.831294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.831294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.831294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.831294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.831294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd274843-22d2-4393-9ea8-b08f21e6f4d6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.986239] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.986928] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.987024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.987413] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.987523] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.988627] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port acd661e5-50d1-40d8-9ab2-883096c92f48 not found, creating... [ 877.989102] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.989240] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.989384] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.991700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.991947] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.992252] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.992426] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.992558] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.992809] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.992941] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.993103] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: acd661e5-50d1-40d8-9ab2-883096c92f48 is going to be created. [ 878.016171] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.016171] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.016171] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.016706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.016706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.016839] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.316049] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.821389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.821579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.821669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.821916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.822025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.822160] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 878.837346] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 878.837554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.837741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.837970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.838170] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.838283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.838692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.838692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.838692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.838692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.838855] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.839897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.839897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.842877] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.843032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.843091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.843254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.843354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.843428] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.849368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.849618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.849618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.851699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.851699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.857524] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 879.063704] env[70032]: INFO networking_nsxv3.common.synchronization [req-fe6798b9-cf06-4cf5-84c1-3f178d153d71 req-35fafe90-607c-44f9-9dd3-d50ed3cf93fd service nova] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_rules [ 879.063704] env[70032]: INFO networking_nsxv3.common.synchronization [req-fe6798b9-cf06-4cf5-84c1-3f178d153d71 req-35fafe90-607c-44f9-9dd3-d50ed3cf93fd service nova] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 879.063704] env[70032]: INFO networking_nsxv3.common.synchronization [req-fe6798b9-cf06-4cf5-84c1-3f178d153d71 req-35fafe90-607c-44f9-9dd3-d50ed3cf93fd service nova] Enqueued Resource ID: acd661e5-50d1-40d8-9ab2-883096c92f48 with Priority: HIGHEST for action port [ 879.063704] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_rules [ 879.063704] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 879.065261] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acd661e5-50d1-40d8-9ab2-883096c92f48 with Priority: HIGHEST for action port [ 879.065618] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.065753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.065837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.066127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.066225] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.068688] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.068688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.068688] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-acd661e5-50d1-40d8-9ab2-883096c92f48 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.068688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.068688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.068688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.068688] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd661e5-50d1-40d8-9ab2-883096c92f48',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.284100] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 879.284417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.284643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.284818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.285814] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.285814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.285814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.285814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.285814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.285814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.285814] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.345454] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.346243] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.571206] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.571206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.575963] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acd661e5-50d1-40d8-9ab2-883096c92f48 with status ACTIVE [ 879.575963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.575963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.575963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.575963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.575963] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acd661e5-50d1-40d8-9ab2-883096c92f48 is going to be updated. [ 879.609854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.609854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.609854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.609854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.610257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.610561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acd661e5-50d1-40d8-9ab2-883096c92f48" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.624558] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: SUCCESS [ 879.624855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.789148] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.789148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.789148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.789148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.789312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.789405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.789405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.789606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.789651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.789713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.789858] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.789968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.790014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.790162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.792843] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.793013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.793092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.793274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.793338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.793430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.793516] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.803513] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 879.803513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.803648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.805946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.806171] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.806291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.806361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.806525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.806683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.806738] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.848379] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af6e748-3c4e-4f35-8470-0d9bbc423daa: rpc.has_security_group_logging(os_id): False [ 879.849549] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.865351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.865761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.865761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.865880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.883422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.884421] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.884421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.884421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.884421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.884421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.884421] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be updated. [ 879.936988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.940173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.940173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.940173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.940173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.954241] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 880.295505] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae: rpc.has_security_group_logging(os_id): False [ 880.309144] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.314456] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.314622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.314731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.315055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.315245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.315823] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.315956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.316036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.316207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.316328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.316491] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.316602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.316764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.316932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.317233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.317474] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.317577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.317640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.317784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.317858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.317945] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be updated. [ 880.357657] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.358018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.358709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.358963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.359106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.359993] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be updated. [ 880.383553] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.383553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.383553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.383553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.383553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.389163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.389288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.389397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.389809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.390131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.396874] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 880.398072] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 880.811809] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.867813] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 880.867813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.867813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.867813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.867813] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.867813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.867813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.868134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.868134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.868134] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.317902] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.317902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.317902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.317902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.317902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.317902] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be updated. [ 881.341048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.341048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.341048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.341048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.344192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.354955] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: IN_PROGRESS for 2s [ 881.379491] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.379491] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.379491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.379491] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be updated. [ 881.401656] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.401656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.401656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.402181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.402557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.415747] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: IN_PROGRESS for 2s [ 881.965919] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 881.965919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.966242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.966425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.966752] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.408292] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 882.408769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.408769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.408916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.409145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.409292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.409404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.409589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.409676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.410999] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.412442] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 882.416025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.469166] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.469387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.609281] env[70032]: INFO networking_nsxv3.common.synchronization [req-7aafc0ed-9304-4d17-95cb-55e6c3b6722e req-02d84eb8-8217-4d51-bef8-cfe288eb42bb tempest-InstanceActionsNegativeTestJSON-1514131944 tempest-InstanceActionsNegativeTestJSON-1514131944-project-member] Enqueued Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_members [ 882.609811] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGHEST for action security_group_members [ 882.610167] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.610289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.610366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.610563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.610715] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.610814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.610876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.611119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.611224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.611322] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.915577] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.014739] env[70032]: INFO networking_nsxv3.common.synchronization [req-49a39f00-1f8a-4ffa-bc43-443a7b9b5c3d req-b728c400-c47b-4b21-9fcf-e1f36bdea0d5 tempest-AttachInterfacesUnderV243Test-1073279179 tempest-AttachInterfacesUnderV243Test-1073279179-project-member] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 883.016475] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGHEST for action security_group_members [ 883.017150] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.017296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.114767] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.114883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.114944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.115254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.115344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.116819] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.116819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.116819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.116819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.116819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.116819] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa is going to be updated. [ 883.145810] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.145810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.145810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.146066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.146125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.155799] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa in Status: IN_PROGRESS for 2s [ 883.365373] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 883.365808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.365999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.366221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.367045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.367045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.367045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.367045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.367045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.369061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.369061] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.417717] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.426751] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 in Status: SUCCESS [ 883.426751] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 deletion is rescheduled due to dependency. [ 883.426751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.870158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.870311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.870381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.871116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.871116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.871116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.871116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.871116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.871350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.871350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.871408] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.871535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.871535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.871664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.873369] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.873369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.873369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.873369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.873369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.873369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.873369] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.919895] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.920122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.920207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.920413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.920506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.920606] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be updated. [ 883.949504] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.949677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.949726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.949921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.950079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.958014] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 884.375178] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1393cc3-6b9b-4326-8077-4648511fe41e: rpc.has_security_group_logging(os_id): False [ 884.392246] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.392418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.392488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.392712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.411186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.411450] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.411576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.411644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.411846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.411933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.412158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.412258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.412322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.412470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.412547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.412722] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.412814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.412959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.413068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.413172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.413259] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be updated. [ 884.472143] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.472143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.472143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.472143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.472143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.482506] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: IN_PROGRESS for 2s [ 885.168121] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa in Status: SUCCESS [ 885.169202] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa deletion is rescheduled due to dependency. [ 885.169202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.521085] env[70032]: INFO networking_nsxv3.common.synchronization [req-8cad2c0e-34f1-428c-8224-9cfb7f4bddee req-93b5587b-0071-4022-833a-d6c17ebc27bd tempest-ServersWithSpecificFlavorTestJSON-1841008358 tempest-ServersWithSpecificFlavorTestJSON-1841008358-project-member] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 885.521523] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 885.521923] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.522269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.522346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.522578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.522741] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.522859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.523049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.523049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.523376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.523376] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.892102] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.893422] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.893561] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.893833] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.894136] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.897030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.897030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.897030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.897030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.897030] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.897030] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.897030] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.897030] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.897030] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.897030] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.897030] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.919047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.919047] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.919047] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.919232] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-490" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.919481] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-73f96470-e78d-4d5c-8867-ce5ef3521c1b taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.919910] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.919910] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.920146] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.920261] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f96470-e78d-4d5c-8867-ce5ef3521c1b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.969462] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 885.969675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.970430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.970430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.970572] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.970634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.970677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.971036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.971036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.971036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.971036] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.971811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.971974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.972143] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.972248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.972311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.972456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.972535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.972626] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.000697] env[70032]: INFO networking_nsxv3.common.synchronization [None req-43e7b640-64f0-4d28-9455-4b3552eceea7 None None] Enqueued Resource ID: a18ba3d9-d057-4e1b-a281-6a38c2d61913 with Priority: HIGHEST for action port [ 886.001223] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18ba3d9-d057-4e1b-a281-6a38c2d61913 with Priority: HIGHEST for action port [ 886.001536] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a18ba3d9-d057-4e1b-a281-6a38c2d61913 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.001702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a18ba3d9-d057-4e1b-a281-6a38c2d61913" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.001702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a18ba3d9-d057-4e1b-a281-6a38c2d61913" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.001985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a18ba3d9-d057-4e1b-a281-6a38c2d61913" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.003131] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a18ba3d9-d057-4e1b-a281-6a38c2d61913',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.026027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.026792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.026792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.026792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.026792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.026988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.027201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.027201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.027299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.027486] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.027486] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef is going to be updated. [ 886.053976] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.053976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.053976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.053976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.053976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.060980] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: IN_PROGRESS for 2s [ 886.332564] env[70032]: INFO networking_nsxv3.common.synchronization [req-4ac6ed29-9712-4851-b4df-4254182ac7b7 req-c79df6c3-5d95-46b5-8fd2-b8152c8281ab tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 886.332740] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 886.333051] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.333173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.333343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.333580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.334121] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.334121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.334121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.334751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.334890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.335030] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.422447] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.422742] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.422829] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.423115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.423269] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.423453] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 73f96470-e78d-4d5c-8867-ce5ef3521c1b not found, creating... [ 886.423886] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.424050] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.424169] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.424411] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.424591] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.424919] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.425222] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.425878] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.425878] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.425878] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.426025] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 73f96470-e78d-4d5c-8867-ce5ef3521c1b is going to be created. [ 886.445695] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.445695] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.445695] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.445695] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.446290] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.446290] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.474075] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.475137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.475267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.475341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.475582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.475673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.475857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.475954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.476021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.476182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.476259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.476344] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be updated. [ 886.496343] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 886.496343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.505877] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a18ba3d9-d057-4e1b-a281-6a38c2d61913 [ 886.506129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.506263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.506333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.506577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.506674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.506767] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a18ba3d9-d057-4e1b-a281-6a38c2d61913 already deleted. [ 886.506850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a18ba3d9-d057-4e1b-a281-6a38c2d61913" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.508081] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.508198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.508266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.508440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.508569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.541022] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 886.837551] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.837725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.837899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.838156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.838282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.838513] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.838648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.838731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.838896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.838978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.839078] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 886.863258] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.863465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.863465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.863755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.863858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.872403] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 886.978110] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af6e748-3c4e-4f35-8470-0d9bbc423daa: rpc.has_security_group_logging(os_id): False [ 886.997065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.997339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.997339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.997575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.999042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.999042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.999042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.999042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.999042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.999042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.999042] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be updated. [ 887.062898] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.062898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.062898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.062898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.062898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.074735] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: IN_PROGRESS for 2s [ 887.266631] env[70032]: INFO networking_nsxv3.common.synchronization [req-8cad2c0e-34f1-428c-8224-9cfb7f4bddee req-d672094d-15f8-4b43-ab2a-932ccdad7965 service nova] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 887.266895] env[70032]: INFO networking_nsxv3.common.synchronization [req-8cad2c0e-34f1-428c-8224-9cfb7f4bddee req-d672094d-15f8-4b43-ab2a-932ccdad7965 service nova] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 887.267123] env[70032]: INFO networking_nsxv3.common.synchronization [req-8cad2c0e-34f1-428c-8224-9cfb7f4bddee req-d672094d-15f8-4b43-ab2a-932ccdad7965 service nova] Enqueued Resource ID: 73f96470-e78d-4d5c-8867-ce5ef3521c1b with Priority: HIGHEST for action port [ 887.267727] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_rules [ 887.267894] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 887.268141] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f96470-e78d-4d5c-8867-ce5ef3521c1b with Priority: HIGHEST for action port [ 887.268507] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.268663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.268749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.268995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.269149] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.270232] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.270353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.270597] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f96470-e78d-4d5c-8867-ce5ef3521c1b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.270726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.270811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.271053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.271157] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f96470-e78d-4d5c-8867-ce5ef3521c1b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.773363] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.773719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.773719] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73f96470-e78d-4d5c-8867-ce5ef3521c1b with status ACTIVE [ 887.773719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.774067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.774067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.774127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.776864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.776864] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.776864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.776864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.776864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.776864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.776864] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.777275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.777275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.777275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.777275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.777396] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73f96470-e78d-4d5c-8867-ce5ef3521c1b is going to be updated. [ 887.797830] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.797830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.797830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.797830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.797830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.797830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f96470-e78d-4d5c-8867-ce5ef3521c1b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.071969] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: SUCCESS [ 888.072878] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef deletion is rescheduled due to dependency. [ 888.072878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.072878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.072878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.072878] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.073138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.073138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.073229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.073229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.073329] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.189129] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-226ceccd-7769-4e7c-b8a3-50e3cc558c94 tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 888.189129] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 888.189129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.189129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.189129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.189424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.189424] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.189494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.189526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.189686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.189781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.189843] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.548899] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 888.549215] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa deletion is rescheduled due to dependency. [ 888.549563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.575606] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.697021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.697205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.697273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.697491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.733633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.733888] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.734022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.734091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.734362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.735070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.735070] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 888.765073] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.765983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.765983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.765983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.765983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.777184] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 888.818706] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.818837] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.819055] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.819521] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.819521] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.819674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.819754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.819962] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.823448] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.823733] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.823812] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.823873] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.823985] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.824111] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.824220] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.824350] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.846089] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.846404] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.846572] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.846856] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.847173] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-4136d576-01e9-4ff5-84d5-28bc5d54484f taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.847462] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.847553] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.847879] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.848029] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4136d576-01e9-4ff5-84d5-28bc5d54484f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.882694] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 888.882694] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 888.882694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.078278] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.091485] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa in Status: SUCCESS [ 889.091748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.351174] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.351424] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.351530] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.351835] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.351948] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.352109] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 4136d576-01e9-4ff5-84d5-28bc5d54484f not found, creating... [ 889.352369] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.352514] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.352631] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.353212] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.353212] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.353439] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.353439] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.353547] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.353790] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.353849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.353985] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 4136d576-01e9-4ff5-84d5-28bc5d54484f is going to be created. [ 889.375735] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.375971] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.376264] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.376407] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.376638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.376862] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.584193] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.586992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.586992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.586992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.586992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.586992] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef is going to be updated. [ 889.618655] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.618834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.618898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.619118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.619261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.636885] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: IN_PROGRESS for 2s [ 890.291862] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-956a1838-b443-48f6-a464-cf9a2a400e8c service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 890.292141] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-956a1838-b443-48f6-a464-cf9a2a400e8c service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 890.292261] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-956a1838-b443-48f6-a464-cf9a2a400e8c service nova] Enqueued Resource ID: 4136d576-01e9-4ff5-84d5-28bc5d54484f with Priority: HIGHEST for action port [ 890.292435] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 890.292607] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 890.292662] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4136d576-01e9-4ff5-84d5-28bc5d54484f with Priority: HIGHEST for action port [ 890.293191] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.293332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.293403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.293610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.293688] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.294926] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.297587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.298261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4136d576-01e9-4ff5-84d5-28bc5d54484f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.298261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.298261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.298261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.298494] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4136d576-01e9-4ff5-84d5-28bc5d54484f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.786680] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 890.786862] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 deletion is rescheduled due to dependency. [ 890.786978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.787158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.787364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.787541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.787651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.787739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.787989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.788086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.788181] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.801220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.801220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.801386] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4136d576-01e9-4ff5-84d5-28bc5d54484f with status ACTIVE [ 890.801492] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.801599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.801667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.801864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.801953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.802133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.802231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.802294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.802438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.802514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.802700] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.802796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.802859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.803026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.803090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.803177] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4136d576-01e9-4ff5-84d5-28bc5d54484f is going to be updated. [ 890.824577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.825107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.825184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.825394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.825575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.825744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4136d576-01e9-4ff5-84d5-28bc5d54484f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.293243] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.482259] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-2a1af4d8-6833-4419-b6b5-6571dd478e8d tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 891.482610] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 891.482900] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.484053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.649518] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: SUCCESS [ 891.649773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.649937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.650173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.650372] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.650491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.650558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.650726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.650780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.650885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.650980] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.795450] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.879106] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.879343] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.879480] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.879753] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.880024] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.881259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.881259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.881259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.881259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.881259] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.881259] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.881259] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.882100] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.882100] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.882100] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.882217] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.899240] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.899408] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.899557] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.899726] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-717" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.900037] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a41bc642-163a-4684-baed-9d2b33e601be taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.900209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.900331] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.900647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.900791] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a41bc642-163a-4684-baed-9d2b33e601be',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.153474] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.301392] env[70032]: INFO networking_nsxv3.common.synchronization [None req-e50fc59a-b5fc-4f4b-911e-be3b142320b0 None None] Enqueued Resource ID: 9d79e251-2848-48fe-965c-08b199b7bc79 with Priority: HIGHEST for action port [ 892.301392] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.301392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.301876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.301876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.302876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.302876] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 892.303510] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d79e251-2848-48fe-965c-08b199b7bc79 with Priority: HIGHEST for action port [ 892.304141] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d79e251-2848-48fe-965c-08b199b7bc79 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.304382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d79e251-2848-48fe-965c-08b199b7bc79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.304473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d79e251-2848-48fe-965c-08b199b7bc79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.304788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d79e251-2848-48fe-965c-08b199b7bc79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.304861] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d79e251-2848-48fe-965c-08b199b7bc79',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.331345] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.331492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.331568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.331833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.332861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.342923] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 892.404568] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.409700] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a41bc642-163a-4684-baed-9d2b33e601be not found, creating... [ 892.409700] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.409700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.410284] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.410284] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.410284] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.410284] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.410284] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.410749] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a41bc642-163a-4684-baed-9d2b33e601be is going to be created. [ 892.430392] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.430913] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.431838] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.434036] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.434036] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.434036] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.656307] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb0f9ea3-e335-4804-8789-09a66f5ffeef: rpc.has_security_group_logging(os_id): False [ 892.673372] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.673554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.673723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.673978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.674119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.674403] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.674514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.674637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.674767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.674823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.674913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef is going to be updated. [ 892.740762] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.740926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.740983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.741191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.741714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.762087] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: IN_PROGRESS for 2s [ 892.807621] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d79e251-2848-48fe-965c-08b199b7bc79 [ 892.807963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.808429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.808429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.808429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.808429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.808429] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d79e251-2848-48fe-965c-08b199b7bc79 already deleted. [ 892.808687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d79e251-2848-48fe-965c-08b199b7bc79" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.233221] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-be92a6a5-b872-41b0-a353-0c51b8a2382b service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 893.234127] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-be92a6a5-b872-41b0-a353-0c51b8a2382b service nova] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 893.234127] env[70032]: INFO networking_nsxv3.common.synchronization [req-74a21e1f-c2bd-4143-a630-8b54489ab147 req-be92a6a5-b872-41b0-a353-0c51b8a2382b service nova] Enqueued Resource ID: a41bc642-163a-4684-baed-9d2b33e601be with Priority: HIGHEST for action port [ 893.234127] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_rules [ 893.234127] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 893.235893] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41bc642-163a-4684-baed-9d2b33e601be with Priority: HIGHEST for action port [ 893.235893] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.235975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.236111] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.236199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.236589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a41bc642-163a-4684-baed-9d2b33e601be taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.236589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.236589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.236796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.236796] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a41bc642-163a-4684-baed-9d2b33e601be',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.740193] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a41bc642-163a-4684-baed-9d2b33e601be with status ACTIVE [ 893.740791] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.740791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.740791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.744089] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.744089] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.744089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.744089] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a41bc642-163a-4684-baed-9d2b33e601be is going to be updated. [ 893.765890] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.766047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.766123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.766338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.766553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.766814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a41bc642-163a-4684-baed-9d2b33e601be" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.352892] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 894.353239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.353680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.353898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.354107] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.354222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.354287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.354435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.354522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.354605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.354700] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.355585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.355751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.355923] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.356047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.356106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.358095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.358095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.358095] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.674936] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8dd8c72d-4d4b-4866-bc3e-859f4b0cd0b0 None None] Enqueued Resource ID: ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22 with Priority: HIGHEST for action port [ 894.675217] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22 with Priority: HIGHEST for action port [ 894.675906] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.676109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.676235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.676617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.676801] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.786438] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: SUCCESS [ 894.786746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.859889] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.860313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.861230] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.182449] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22 [ 895.183933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.183933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.183933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.183933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.183933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.183933] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22 already deleted. [ 895.183933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac82bc4e-105c-4394-b7c0-5a8c3a2d3f22" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.365455] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.874625] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.874929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.874929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.875092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.875184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.875280] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 895.902308] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.902534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.902534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.902733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.902884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.912858] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 897.924707] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 897.925095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.925095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.925271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.925453] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.925627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.925687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.925845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.926071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.926071] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.239730] env[70032]: INFO networking_nsxv3.common.synchronization [req-95717e95-2350-4995-93ae-61a3de2e3f3d req-a6ca36f0-fe14-472d-9dfe-eff293e7952b tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 898.240203] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 898.240517] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.241064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.241064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.241064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.241064] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.241861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.241861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.241861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.241861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.242141] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.428940] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.561133] env[70032]: INFO networking_nsxv3.common.synchronization [req-a1490169-372d-49a3-ac99-fc808283f64e req-a1c84481-2178-4e59-91a9-5e8ddde2b602 tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 898.561133] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 898.561133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.561133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.561133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.561133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.561133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.562188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.562280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.562438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.562527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.562625] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.746015] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.746195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.746271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.746490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.746610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.746809] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.746907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.747237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.748415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.748521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.748627] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be updated. [ 898.785833] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.785981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.786074] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.786418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.786418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.796119] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 898.931961] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.067540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.067540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.067540] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 already deleted. [ 899.067540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.179198] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.179198] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.179198] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.179198] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.179761] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.180221] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.180799] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.181243] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.181798] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.182196] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.182473] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.182721] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.183012] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.183289] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.183565] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.183830] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.210224] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.210224] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.210224] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.210224] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.210224] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-85359b1f-b361-4765-aea0-6b22b350e899 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.210562] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.210562] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.210862] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.211011] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85359b1f-b361-4765-aea0-6b22b350e899',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.316932] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b982f6cc-5dc7-4797-9a30-d7a858c2ab55 None None] Enqueued Resource ID: a2bb7a8e-f59d-465e-b450-32d7f4c641c7 with Priority: HIGHEST for action port [ 899.317594] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2bb7a8e-f59d-465e-b450-32d7f4c641c7 with Priority: HIGHEST for action port [ 899.318304] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2bb7a8e-f59d-465e-b450-32d7f4c641c7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.318304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2bb7a8e-f59d-465e-b450-32d7f4c641c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.318304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2bb7a8e-f59d-465e-b450-32d7f4c641c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.318496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2bb7a8e-f59d-465e-b450-32d7f4c641c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.318496] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2bb7a8e-f59d-465e-b450-32d7f4c641c7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.435512] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.435759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.436039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.436200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.436323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.436448] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 899.465151] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.465329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.465376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.465679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.465831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.475292] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 899.714292] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.714536] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.714667] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.714962] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.715139] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.715282] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 85359b1f-b361-4765-aea0-6b22b350e899 not found, creating... [ 899.715637] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.715842] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.715980] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.716233] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.716353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.716660] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.716845] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.716954] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.717624] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.717778] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.717945] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 85359b1f-b361-4765-aea0-6b22b350e899 is going to be created. [ 899.741307] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.741518] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.741665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.741929] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.742165] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.742386] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.824027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2bb7a8e-f59d-465e-b450-32d7f4c641c7 [ 899.824027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.824027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.824027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.824027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.824318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.824318] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2bb7a8e-f59d-465e-b450-32d7f4c641c7 already deleted. [ 899.824318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2bb7a8e-f59d-465e-b450-32d7f4c641c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.335350] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ac878b24-7c06-412c-8cb3-70a0de0f7a0b None None] Enqueued Resource ID: 5bfa4523-704a-494d-b0ce-04c0507f03bb with Priority: HIGHEST for action port [ 900.335903] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bfa4523-704a-494d-b0ce-04c0507f03bb with Priority: HIGHEST for action port [ 900.336221] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bfa4523-704a-494d-b0ce-04c0507f03bb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.336336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bfa4523-704a-494d-b0ce-04c0507f03bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.336399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bfa4523-704a-494d-b0ce-04c0507f03bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.336673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bfa4523-704a-494d-b0ce-04c0507f03bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.336772] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bfa4523-704a-494d-b0ce-04c0507f03bb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.738840] env[70032]: INFO networking_nsxv3.common.synchronization [req-a1490169-372d-49a3-ac99-fc808283f64e req-8e0c24cd-2f13-4471-b072-f2a5e24f2bdb service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 900.738840] env[70032]: INFO networking_nsxv3.common.synchronization [req-a1490169-372d-49a3-ac99-fc808283f64e req-8e0c24cd-2f13-4471-b072-f2a5e24f2bdb service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 900.738840] env[70032]: INFO networking_nsxv3.common.synchronization [req-a1490169-372d-49a3-ac99-fc808283f64e req-8e0c24cd-2f13-4471-b072-f2a5e24f2bdb service nova] Enqueued Resource ID: 85359b1f-b361-4765-aea0-6b22b350e899 with Priority: HIGHEST for action port [ 900.738840] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 900.738840] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 900.738840] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85359b1f-b361-4765-aea0-6b22b350e899 with Priority: HIGHEST for action port [ 900.738840] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.740993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.741113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.741349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.741434] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.745030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.745030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.745030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.745030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.745030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.745030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.745030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.745030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.745030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.745030] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.746166] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-85359b1f-b361-4765-aea0-6b22b350e899 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.746254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.746357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.746551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.746668] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85359b1f-b361-4765-aea0-6b22b350e899',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.805614] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 900.805821] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae deletion is rescheduled due to dependency. [ 900.805939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.849011] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bfa4523-704a-494d-b0ce-04c0507f03bb [ 900.849256] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.849387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.849463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.849663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.849753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.849842] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bfa4523-704a-494d-b0ce-04c0507f03bb already deleted. [ 900.849919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bfa4523-704a-494d-b0ce-04c0507f03bb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.251096] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.251096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.251096] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.251096] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85359b1f-b361-4765-aea0-6b22b350e899 with status ACTIVE [ 901.251096] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.251096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.251096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.252329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.252329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.252329] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.252329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.252329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.252329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.252329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.252784] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.252784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.253166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.253714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.253714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.253714] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85359b1f-b361-4765-aea0-6b22b350e899 is going to be updated. [ 901.276771] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.276771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.276771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.276771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.276771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.276771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85359b1f-b361-4765-aea0-6b22b350e899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.484839] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 901.485092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.485239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.485452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.485701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.485844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.485890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.486032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.486118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.486204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.486360] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.486453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.486566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.486687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.486832] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.486927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.486983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.487139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.487215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.487296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.487385] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.757361] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.835113] env[70032]: INFO networking_nsxv3.common.synchronization [None req-544f5cd5-9269-4976-b6c3-3e08204f9a6e tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_rules [ 901.836544] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_rules [ 901.836544] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d451476b-b529-46a5-ac42-f7b74140c983 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.836544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.836544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.836544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.836544] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.905844] env[70032]: INFO networking_nsxv3.common.synchronization [None req-9f4487a6-d400-46d4-943c-d1a1c9787af5 None None] Enqueued Resource ID: fb5815b7-2c5c-48a2-81a0-fc17c79e7037 with Priority: HIGHEST for action port [ 901.905998] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb5815b7-2c5c-48a2-81a0-fc17c79e7037 with Priority: HIGHEST for action port [ 901.906315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb5815b7-2c5c-48a2-81a0-fc17c79e7037 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.906467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb5815b7-2c5c-48a2-81a0-fc17c79e7037" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.907120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb5815b7-2c5c-48a2-81a0-fc17c79e7037" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.907120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb5815b7-2c5c-48a2-81a0-fc17c79e7037" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.907199] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5815b7-2c5c-48a2-81a0-fc17c79e7037',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.990035] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42d4b17b-1bab-41c3-94ca-ac72b8e35f54: rpc.has_security_group_logging(os_id): False [ 901.994157] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8f4aae97-9a52-4eb3-927b-8a1022c0330d tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_rules [ 901.995083] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_rules [ 901.995390] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d451476b-b529-46a5-ac42-f7b74140c983 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.995493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.012959] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.012959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.012959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.013339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.013339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.013339] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.013471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.013471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.013741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.013741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.013883] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.014053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.014053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.014212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.014288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.016819] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.016933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.016999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.017199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.017328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.018126] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 902.076991] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.078441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.078441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.078441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.078441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.090462] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 902.262183] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.262183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.262183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.262183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.262183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.262183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 902.264391] env[70032]: INFO networking_nsxv3.common.synchronization [None req-df4b4830-9abc-42a3-9c20-78bd6f650a84 None None] Enqueued Resource ID: 2be687ac-0953-4586-b6f5-97ba58c7f4c7 with Priority: HIGHEST for action port [ 902.266484] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2be687ac-0953-4586-b6f5-97ba58c7f4c7 with Priority: HIGHEST for action port [ 902.267251] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2be687ac-0953-4586-b6f5-97ba58c7f4c7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.267498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2be687ac-0953-4586-b6f5-97ba58c7f4c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.267692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2be687ac-0953-4586-b6f5-97ba58c7f4c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.268057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2be687ac-0953-4586-b6f5-97ba58c7f4c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.268384] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2be687ac-0953-4586-b6f5-97ba58c7f4c7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.289515] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.289515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.289515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.289515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.289515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.296704] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: UNINITIALIZED for 2s [ 902.358503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.358639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.358995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.358995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.359111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.359155] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d451476b-b529-46a5-ac42-f7b74140c983 already deleted. [ 902.359266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.361206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.361206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.361206] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.409895] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb5815b7-2c5c-48a2-81a0-fc17c79e7037 [ 902.413129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.413129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.413129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.413129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.413129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.413129] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb5815b7-2c5c-48a2-81a0-fc17c79e7037 already deleted. [ 902.413129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb5815b7-2c5c-48a2-81a0-fc17c79e7037" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.537488] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.537835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.537835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.538156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.538287] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.771400] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2be687ac-0953-4586-b6f5-97ba58c7f4c7 [ 902.771649] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.771777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.771844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.772085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.772185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.772264] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2be687ac-0953-4586-b6f5-97ba58c7f4c7 already deleted. [ 902.772341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2be687ac-0953-4586-b6f5-97ba58c7f4c7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.884777] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.884777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.884777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.884777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.884777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.884777] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d451476b-b529-46a5-ac42-f7b74140c983 already deleted. [ 902.884777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.041953] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.546753] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.958302] env[70032]: INFO networking_nsxv3.common.synchronization [req-29d2d82c-6f50-463a-adb8-993eb30b5e69 req-edc14da5-6461-4d02-9957-6562d429cfd3 tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 903.958760] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 903.959071] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.959194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.959261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.959453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.959598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.959693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.959754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.960160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.960160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.960160] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.048960] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 904.049106] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 904.104608] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 904.104841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.105030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.105250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.105346] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.273234] env[70032]: INFO networking_nsxv3.common.synchronization [req-6b656506-84a1-4835-9c92-e9c5f1c8f092 req-ec04ed0d-f723-4f26-a759-8e8c9e53a097 tempest-MultipleCreateTestJSON-706360947 tempest-MultipleCreateTestJSON-706360947-project-member] Enqueued Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 904.273388] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 with Priority: HIGHEST for action security_group_members [ 904.273850] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.273970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.305380] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 904.305656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.306087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.306298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.306561] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.306716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.306800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.307013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.307192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.307302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.307410] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.468554] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.611465] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.611759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.813505] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.813786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.813831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.814029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.814347] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.814347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.814441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.814513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.814598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.814692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.814875] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.814976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.815047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.815189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.815325] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.816344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.816344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.816344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.816344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.816344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.816344] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.821415] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.821668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.822029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.822029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.834689] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 904.836346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.837609] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 904.839454] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f0e8ca4-9613-4991-a992-cf2ef6089b55: rpc.has_security_group_logging(os_id): False [ 904.856971] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.857389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.857487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.857715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.857801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.858222] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.859093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.859093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.859093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.859093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.859093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.859093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.859093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.859442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.859442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.859729] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.859826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.859887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.860056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.860115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.860190] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 904.868644] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.868994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.868994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.869169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.882924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.883509] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 904.883602] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 904.883690] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 904.927642] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.927866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.927924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.928152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.928329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.941978] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.942124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.942200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.942528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.943633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.943791] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 904.945671] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: IN_PROGRESS for 2s [ 904.972613] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.003036] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.003036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.003036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.003036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.003036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.005128] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 905.085784] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.085931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.086009] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.086521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.086807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.087630] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 905.087805] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e2ef9c9c-f8d6-4b45-b624-16d16cab2727', '465b2315-38b5-4037-b159-5d8565fe0f2f', '21f87689-4053-460b-b9e6-259755632006', '17fd7384-1e1f-4823-baff-e68bca324f40', 'b4ccf82f-3b6f-46ee-bfb8-395c2be74f50', '415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa', '8359b363-4508-4e0c-909f-bfb6605cb735', '95997ae8-ded3-4f2f-85bd-5d180ad401b9', 'c2546188-fcd4-4401-b075-87ffd0e4a9a9', 'aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4', 'c252e10b-b1d9-4f18-a7ed-801f82010adb', '29db5c69-ae7f-4532-a586-567cdaa588c3', '7d281ff3-2359-4e29-9dd6-c4d2eeed68a0', '57166f3a-68e3-48b8-984a-2376cb60573f', '55c6c5eb-e161-4d2f-aadb-6f74ba12d141', '14c7722e-02ea-467c-af4c-394e1f839b23', 'c1d61d13-44e5-4c83-936b-8a6c378d760a', '7dc6b078-d4c5-4e0d-955f-af7c0818a2ae', 'b1393cc3-6b9b-4326-8077-4648511fe41e', '1ac44685-7555-444d-b1ce-19ece671a825', '0af6e748-3c4e-4f35-8470-0d9bbc423daa', 'd880077d-b1e8-47fa-bc09-7da9308456b0', '61533d93-47dd-40b4-b191-9d366077f93c', '1e94337d-b9be-48c8-8c35-01c45e2baf7c', '00b9cad3-7556-42c3-8caf-441973387e39', '4e2dd745-ad31-4195-9f0e-c534fa480580', '449f8b7d-089e-4037-adbd-8e1125cab8b6', '5000c8de-0235-4e38-93be-83111bb42b93', 'f5730a18-9b02-4aad-abe1-e7789de465fd', '00371e37-ee75-4ff4-9639-24f7314003da', 'bb0f9ea3-e335-4804-8789-09a66f5ffeef', 'c54f2196-33e3-453f-a911-75188cea4a01', '42d4b17b-1bab-41c3-94ca-ac72b8e35f54', 'b20098c3-4944-4612-af2a-f2d01874388d'} {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 905.087974] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 905.111974] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.112180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.112257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.112484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.112579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.112689] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 905.112782] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 905.112854] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 905.181960] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.184013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.184013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.184013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.184013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.184013] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 905.184013] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 905.184382] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 905.184382] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 905.184382] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 905.184382] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGH for action security_group_rules [ 905.184382] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGH for action security_group_rules [ 905.184544] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGH for action security_group_rules [ 905.184544] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGH for action security_group_rules [ 905.184544] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGH for action security_group_rules [ 905.184681] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGH for action security_group_rules [ 905.184681] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGH for action security_group_rules [ 905.184738] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGH for action security_group_rules [ 905.184773] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGH for action security_group_rules [ 905.184835] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGH for action security_group_rules [ 905.184866] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGH for action security_group_rules [ 905.184924] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGH for action security_group_rules [ 905.185037] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGH for action security_group_rules [ 905.185106] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGH for action security_group_rules [ 905.185151] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGH for action security_group_rules [ 905.185283] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGH for action security_group_rules [ 905.185283] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGH for action security_group_rules [ 905.185390] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGH for action security_group_rules [ 905.185390] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGH for action security_group_rules [ 905.185484] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGH for action security_group_rules [ 905.185528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.213037] env[70032]: INFO networking_nsxv3.common.synchronization [req-b486fce1-ab09-49f8-9d3a-9b5b5f88591f req-e225cc7c-39c2-448e-ab7a-8ffa56711488 tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 905.213711] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 905.213711] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGH for action security_group_rules [ 905.213711] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f87689-4053-460b-b9e6-259755632006 with Priority: HIGH for action security_group_rules [ 905.213869] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8359b363-4508-4e0c-909f-bfb6605cb735 with Priority: HIGH for action security_group_rules [ 905.213869] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 with Priority: HIGH for action security_group_rules [ 905.213965] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGH for action security_group_rules [ 905.214323] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGH for action security_group_rules [ 905.214451] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGH for action security_group_rules [ 905.214545] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGH for action security_group_rules [ 905.214990] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGH for action security_group_rules [ 905.214990] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGH for action security_group_rules [ 905.214990] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 with Priority: HIGH for action security_group_rules [ 905.214990] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 with Priority: HIGH for action security_group_rules [ 905.215161] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c252e10b-b1d9-4f18-a7ed-801f82010adb with Priority: HIGH for action security_group_rules [ 905.215161] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 with Priority: HIGH for action security_group_rules [ 905.215500] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGH for action security_group_rules [ 905.215500] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa with Priority: HIGH for action security_group_rules [ 905.215500] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 with Priority: HIGH for action security_group_rules [ 905.215500] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 with Priority: HIGH for action security_group_rules [ 905.215660] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465b2315-38b5-4037-b159-5d8565fe0f2f with Priority: HIGH for action security_group_rules [ 905.215692] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGH for action security_group_rules [ 905.216254] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.216254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.216254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.216587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.216691] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.216795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.216856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.217034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.217116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.217225] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.218178] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.218299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.218364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.218857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.218900] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.219699] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f87689-4053-460b-b9e6-259755632006 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.219835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.219903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.220300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.220397] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f87689-4053-460b-b9e6-259755632006',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.221139] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8359b363-4508-4e0c-909f-bfb6605cb735 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.221504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.221619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.221748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.221824] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8359b363-4508-4e0c-909f-bfb6605cb735',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.222982] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.223166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.223203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.223354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.223689] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55c6c5eb-e161-4d2f-aadb-6f74ba12d141',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.224503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.224628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.224700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.224877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.224927] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.232250] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.232368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.232368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.232580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.232580] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.233627] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.233743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.233811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.233973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.234674] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.235721] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.235721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.235721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.235721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.235721] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.237647] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.237647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.237647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.237647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.237647] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.238163] env[70032]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 905.238420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.238577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.238577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.238739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.238806] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.240395] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.240521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.240692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.241509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.241509] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d281ff3-2359-4e29-9dd6-c4d2eeed68a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.242808] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29db5c69-ae7f-4532-a586-567cdaa588c3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.242808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.242808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.242808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.242808] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29db5c69-ae7f-4532-a586-567cdaa588c3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.243565] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c252e10b-b1d9-4f18-a7ed-801f82010adb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.243681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.243921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.244210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.244862] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c252e10b-b1d9-4f18-a7ed-801f82010adb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.245093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.245252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.245305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.245431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.245502] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.249016] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.249016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.249016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.249016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.249016] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.249016] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.249016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.249016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.249016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.249016] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.249926] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.249926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.249926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.250112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.250155] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95997ae8-ded3-4f2f-85bd-5d180ad401b9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.250988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.251107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.251166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.251342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.251400] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4ccf82f-3b6f-46ee-bfb8-395c2be74f50',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.252278] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-465b2315-38b5-4037-b159-5d8565fe0f2f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.252394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.252449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.254020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.254020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('465b2315-38b5-4037-b159-5d8565fe0f2f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.254020] env[70032]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 905.254020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.254020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.254020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.254020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.254020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.258065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.258194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.258250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.258401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.258552] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.258648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.258712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.258850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.258936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.259105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.259220] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.477039] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.477039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.477272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.477320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.477615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.477615] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 905.506367] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.506367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.506367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.506367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.506367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.514201] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 905.639560] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.639851] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.639970] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.640317] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.640572] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.640793] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.640911] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.641154] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.641303] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.641528] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.641679] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.641757] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.642849] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.642849] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.642849] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.642849] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.661379] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.661379] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 905.661379] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.661379] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.661379] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-744eb575-406c-466d-88aa-d8413f5b1b08 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.661379] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.661379] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.661379] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.661379] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('744eb575-406c-466d-88aa-d8413f5b1b08',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.756350] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.756516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.756554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.756906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.757079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.757257] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.757368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.757434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.757627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.757722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.757815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 already deleted. [ 905.757922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.760407] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.776637] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.776780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.776849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.777071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.782114] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.782114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.787686] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.787791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.787865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.788176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.788315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.788416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.788479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.788630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.788719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.788806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.788905] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.793121] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.793267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.793349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.793532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.793687] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.793798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.793863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.794014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.794098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.794180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.794265] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.796681] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.796681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.796681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.796681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.796920] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.796920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.796920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.797064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.797918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.797918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.797918] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.802119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.802119] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8359b363-4508-4e0c-909f-bfb6605cb735 is going to be deleted. [ 905.808093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.808189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.808239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.808401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.808566] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.808684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.808750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.808896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.808971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.809066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.809146] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.811943] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.812069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.812140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.812296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.812542] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.812542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.812630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.812733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.812827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.812934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.813041] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.817515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.817515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.831053] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.831195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.831266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.831467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.831631] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.831731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.831795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.831948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.832044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.832129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.832272] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.832364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.832420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.832560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.832693] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.832781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.832834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.832967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.833063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.833144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.833229] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.838486] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.838575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.855884] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.856057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.861183] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.861294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.862104] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.862190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.863988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.864107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.865070] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.865250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.865947] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.866063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.866772] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.866859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.867676] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.867778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.869111] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.869228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.870015] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 905.870389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.870483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.871937] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 905.872413] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.872505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.873142] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 905.873520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.873651] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f87689-4053-460b-b9e6-259755632006 is going to be deleted. [ 905.874511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.874710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.901852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.902041] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29db5c69-ae7f-4532-a586-567cdaa588c3 is going to be deleted. [ 905.902992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.903836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.905244] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.905377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.922383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.923630] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95997ae8-ded3-4f2f-85bd-5d180ad401b9 is going to be deleted. [ 905.923630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.923630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.934424] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.935302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.942309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.942440] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa is going to be deleted. [ 905.943458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.943799] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.954036] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.954351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.961461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.961461] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be deleted. [ 905.962310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.962504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.987402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.987545] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4 is going to be deleted. [ 905.988948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.988948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.990361] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.990468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.037585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.037643] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c252e10b-b1d9-4f18-a7ed-801f82010adb is going to be deleted. [ 906.038611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.038798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.040811] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.040921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.043620] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.043845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.086350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.086645] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d281ff3-2359-4e29-9dd6-c4d2eeed68a0 is going to be deleted. [ 906.087683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.088036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.128067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.128218] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4ccf82f-3b6f-46ee-bfb8-395c2be74f50 is going to be deleted. [ 906.129218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.129437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.130857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.130925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.132651] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.132651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.164379] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.164616] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.164753] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.165053] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.165214] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.165375] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 744eb575-406c-466d-88aa-d8413f5b1b08 not found, creating... [ 906.165656] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.165876] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.166358] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.166358] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.166544] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.166815] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.166918] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.167045] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.167265] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.167411] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.167553] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 744eb575-406c-466d-88aa-d8413f5b1b08 is going to be created. [ 906.181980] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.182122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.200095] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.200278] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.200315] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.201307] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.201307] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.201307] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.203492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.203492] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be deleted. [ 906.203718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.203753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.265582] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2ef9c9c-f8d6-4b45-b624-16d16cab2727: rpc.has_security_group_logging(os_id): False [ 906.269607] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.269736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.283300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.283447] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be deleted. [ 906.284428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.284633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.291907] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.301300] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.301300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.301534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.301587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.301879] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.301879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.302058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.302112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.302199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.302289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.302432] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.302531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.302582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.302718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.302843] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.302938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.302991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.303256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.303256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.303321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.303389] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.310774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.311062] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55c6c5eb-e161-4d2f-aadb-6f74ba12d141 is going to be deleted. [ 906.311773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.312024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.313773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.313876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.318172] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.319551] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.336933] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2546188-fcd4-4401-b075-87ffd0e4a9a9: rpc.has_security_group_logging(os_id): False [ 906.341238] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.341379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.383303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.383959] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 465b2315-38b5-4037-b159-5d8565fe0f2f is going to be deleted. [ 906.384658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.384792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.384919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.385082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8359b363-4508-4e0c-909f-bfb6605cb735" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.385833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.386082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.386225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.386340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f87689-4053-460b-b9e6-259755632006" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.386880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.387089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.387752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.387752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29db5c69-ae7f-4532-a586-567cdaa588c3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.387752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.387752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.387752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.388234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95997ae8-ded3-4f2f-85bd-5d180ad401b9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.388234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.388234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.388362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.388573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.389040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.389184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.389291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.389510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.469360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.469648] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.469784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.469850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.470084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.470183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.470402] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.470498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.470572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.470725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.470815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.471027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.471170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.471170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.471389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.471389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.471558] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be updated. [ 906.472659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.472831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.472927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.473071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c252e10b-b1d9-4f18-a7ed-801f82010adb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.473215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.473374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.473455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.473575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aedd9f2d-7f9b-45c4-90cb-bd86aa7dbda4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.474314] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.474424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.474493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.474746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.474844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.474977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.475119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.475280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.475358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.475480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d281ff3-2359-4e29-9dd6-c4d2eeed68a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.475638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.475774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.475871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.475987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4ccf82f-3b6f-46ee-bfb8-395c2be74f50" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.476507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.476686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.498560] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.498813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.520462] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.520628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.525351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.525741] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.525901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.525980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.526210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.526301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.526404] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 is going to be updated. [ 906.527493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.527674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.527767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.528023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.528197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.528324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.528407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.528521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-415d0c82-aa60-40c2-9bc9-e3fe6f6a93fa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.528667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.528844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.528922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.529500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55c6c5eb-e161-4d2f-aadb-6f74ba12d141" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.529500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.529500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.529500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.529500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-465b2315-38b5-4037-b159-5d8565fe0f2f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.674334] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.674615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.674615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.674778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.674930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.706718] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.706878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.706967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.707300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.707410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.726179] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: IN_PROGRESS for 2s [ 906.743938] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 906.744343] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: IN_PROGRESS for 2s [ 906.797882] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14c7722e-02ea-467c-af4c-394e1f839b23: rpc.has_security_group_logging(os_id): False [ 906.805644] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1393cc3-6b9b-4326-8077-4648511fe41e: rpc.has_security_group_logging(os_id): False [ 906.821585] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17fd7384-1e1f-4823-baff-e68bca324f40: rpc.has_security_group_logging(os_id): False [ 906.825250] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57166f3a-68e3-48b8-984a-2376cb60573f: rpc.has_security_group_logging(os_id): False [ 906.832453] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.832453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.832453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.832453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.842037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.842037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.844312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.844312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.850304] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.850304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.863674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.863674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.863674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.863674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.863674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.863674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.863674] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 is going to be updated. [ 906.864419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.864583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.887433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.887709] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.887835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.887951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.888255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.888373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.888627] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.888735] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.888802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.888970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.889058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.889238] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.889318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.889379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.889519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.889594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.889687] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be updated. [ 906.890775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.890940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.913118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.913454] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.913627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.913720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.913941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.914108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.914227] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 is going to be updated. [ 906.915259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.915435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.932992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.933319] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.933440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.933522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.933722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.933807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.933896] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f is going to be updated. [ 906.946541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.946725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.946782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.946953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.947104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.958316] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 906.958517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.959196] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: IN_PROGRESS for 2s [ 906.970290] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.970290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.970290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.970290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.970582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.971925] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.972051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.972121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.972282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.972401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.997504] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: IN_PROGRESS for 2s [ 906.998522] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: IN_PROGRESS for 2s [ 907.001932] env[70032]: INFO networking_nsxv3.common.synchronization [req-b486fce1-ab09-49f8-9d3a-9b5b5f88591f req-d9d48461-86f7-43b1-9619-04a88fdcd742 service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 907.002145] env[70032]: INFO networking_nsxv3.common.synchronization [req-b486fce1-ab09-49f8-9d3a-9b5b5f88591f req-d9d48461-86f7-43b1-9619-04a88fdcd742 service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 907.002289] env[70032]: INFO networking_nsxv3.common.synchronization [req-b486fce1-ab09-49f8-9d3a-9b5b5f88591f req-d9d48461-86f7-43b1-9619-04a88fdcd742 service nova] Enqueued Resource ID: 744eb575-406c-466d-88aa-d8413f5b1b08 with Priority: HIGHEST for action port [ 907.002512] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 907.002633] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 907.002729] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744eb575-406c-466d-88aa-d8413f5b1b08 with Priority: HIGHEST for action port [ 907.003252] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.003383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.003435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.003673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.003755] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.004691] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.004691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.004787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.005100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.005100] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.005186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.007034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.007034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.007034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.007034] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.007034] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-744eb575-406c-466d-88aa-d8413f5b1b08 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.007034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.007034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.007034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.007034] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('744eb575-406c-466d-88aa-d8413f5b1b08',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.031767] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.031941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.031996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.032845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.032845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.047973] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: IN_PROGRESS for 2s [ 907.508682] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.508823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.509029] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.510044] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 744eb575-406c-466d-88aa-d8413f5b1b08 with status ACTIVE [ 907.512990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.512990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.512990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.512990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.512990] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 744eb575-406c-466d-88aa-d8413f5b1b08 is going to be updated. [ 907.526052] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 907.526325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.526429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.526660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.526847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.526958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.527030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.527184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.527260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.527357] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.534662] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.535147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.535259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.535464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.535641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.535873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-744eb575-406c-466d-88aa-d8413f5b1b08" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.014715] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.032425] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.032626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.032712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.032934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.052657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.052918] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.053052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.053188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.053563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.053665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.053744] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 908.075137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.075137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.075322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.075362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.075500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.082678] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 908.521807] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.521961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.522069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.522286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.522375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.522477] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be created. [ 908.545534] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.548019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.548019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.548019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.548019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.558183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: UNINITIALIZED for 2s [ 908.747553] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 908.747815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.756200] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: SUCCESS [ 908.756344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.971597] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: SUCCESS [ 908.971597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.010968] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: SUCCESS [ 909.011272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.012121] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 909.012434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.059665] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: SUCCESS [ 909.059953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.062855] env[70032]: INFO networking_nsxv3.common.synchronization [req-bb1009b3-b2ab-4ae7-9d0b-c527059385ad req-bd86d41b-7228-4a6c-84d5-44181e3bba56 tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 910.063446] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 910.063788] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.063910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.092747] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 910.092934] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 deletion is rescheduled due to dependency. [ 910.093128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.093499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.094551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.095327] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.095327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.095327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.095327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.095327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.095583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.095690] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.392458] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.392665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.392796] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.393072] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.393338] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.393496] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.393701] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.394045] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.394221] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.394443] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.394564] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.394706] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.394901] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.395046] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.395165] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.395305] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.412752] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.412907] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.413064] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.413236] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.413642] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-e1b19b62-125c-4613-a259-af3583be274f taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.413825] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.413949] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.414277] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.414420] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1b19b62-125c-4613-a259-af3583be274f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.566421] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 910.566632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.566785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.566985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.567176] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.567288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.567355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.567502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.567583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.567667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.567760] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.568530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.568713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.568873] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.568973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.569048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.569188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.569297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.569349] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.598402] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.598549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.598631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.598843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.599007] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.599140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.599236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.599397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.599485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.599579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.599723] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.599816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.599876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.600020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.600157] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.600246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.600304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.600434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.600506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.600585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.600671] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42d4b17b-1bab-41c3-94ca-ac72b8e35f54',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.916619] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.916880] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.917022] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.917309] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.917469] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.917626] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port e1b19b62-125c-4613-a259-af3583be274f not found, creating... [ 910.917884] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.918075] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.918210] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.918441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.918581] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.921101] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.921101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.921101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.921101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.921101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.921101] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: e1b19b62-125c-4613-a259-af3583be274f is going to be created. [ 910.947199] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.947412] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.947548] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.947829] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.948060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.948300] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.071280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.071618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.071618] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.103731] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42d4b17b-1bab-41c3-94ca-ac72b8e35f54: rpc.has_security_group_logging(os_id): False [ 911.120135] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.120283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.120397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.120556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.120647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.120842] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.120937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.120998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.121416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.121416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.121416] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.121637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.121637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.121695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.121758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.121964] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.122077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.122077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.122216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.122275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.122359] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 is going to be updated. [ 911.179086] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.179269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.179412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.179516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.179660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.207052] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: IN_PROGRESS for 2s [ 911.574278] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.666272] env[70032]: INFO networking_nsxv3.common.synchronization [req-bb1009b3-b2ab-4ae7-9d0b-c527059385ad req-61e8e2e7-bf6f-4f0e-98bc-01655073eeab service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 911.666272] env[70032]: INFO networking_nsxv3.common.synchronization [req-bb1009b3-b2ab-4ae7-9d0b-c527059385ad req-61e8e2e7-bf6f-4f0e-98bc-01655073eeab service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 911.666272] env[70032]: INFO networking_nsxv3.common.synchronization [req-bb1009b3-b2ab-4ae7-9d0b-c527059385ad req-61e8e2e7-bf6f-4f0e-98bc-01655073eeab service nova] Enqueued Resource ID: e1b19b62-125c-4613-a259-af3583be274f with Priority: HIGHEST for action port [ 911.666272] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 911.666272] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 911.666272] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1b19b62-125c-4613-a259-af3583be274f with Priority: HIGHEST for action port [ 911.666272] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.666272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.668765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.668765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.668765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1b19b62-125c-4613-a259-af3583be274f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.668765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.668765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.668765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.668765] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1b19b62-125c-4613-a259-af3583be274f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.076700] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.077023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.077023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.077204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.077308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.077408] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 912.104027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.104199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.104274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.104491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.104636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.113212] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 912.170601] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1b19b62-125c-4613-a259-af3583be274f with status ACTIVE [ 912.170871] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.171022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.171094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.171316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.171413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.171588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.171682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.171786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.171953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.172043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.172230] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.172325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.172385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.172562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.172631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.172718] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1b19b62-125c-4613-a259-af3583be274f is going to be updated. [ 912.193722] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.193722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.193830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.194118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.194217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.194431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1b19b62-125c-4613-a259-af3583be274f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.224087] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42d4b17b-1bab-41c3-94ca-ac72b8e35f54 in Status: SUCCESS [ 913.224356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42d4b17b-1bab-41c3-94ca-ac72b8e35f54" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.123082] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 4s [ 916.134749] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 916.134749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.134749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.135147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.135243] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.135365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.135431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.135593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.135694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.135788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.135951] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.136051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.136113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.136256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.136392] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.136483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.136543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.136694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.136782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.137050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.137050] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.138023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.138170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.138348] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.138482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.138573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.138750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.138866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.138979] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.640255] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 750167f1-a8ae-4a8e-a9a0-cd5ce2550684: rpc.has_security_group_logging(os_id): False [ 916.641535] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.658471] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.658613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.658699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.661174] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.661174] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.661174] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.661174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.661728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.661728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.661728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.661728] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be created. [ 916.666813] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 916.666930] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 916.716059] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.716059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.716059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.716059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.716059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.727908] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 916.966265] env[70032]: INFO networking_nsxv3.common.synchronization [req-52f039fd-7d68-48f7-a33b-261326cefa95 req-f47a210f-60aa-41dd-8a14-123c77d08763 tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 916.966813] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 916.967158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.967246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.967342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.967500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.967645] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.967740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.967804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.967946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.971610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.971610] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.144012] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.418751] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.418960] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.419103] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.419364] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.419620] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.419791] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.419901] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.420436] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.420608] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.420829] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.420947] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.421120] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.421243] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.421489] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.421489] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.421774] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.438679] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.438869] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.439027] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.439214] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.439533] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-246e69d4-018f-4210-9d5d-c842da84afd4 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.439711] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.439837] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.440183] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.440325] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('246e69d4-018f-4210-9d5d-c842da84afd4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.472456] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.472802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.472978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.473284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.473511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.473805] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.474498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.474498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.474498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.474498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.474498] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be deleted. [ 917.501642] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.501791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.501860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.502109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.502199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.502294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.648290] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.648523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.648626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.648877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.649075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.649147] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 917.677713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.677834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.677900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.678123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.678280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.687153] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 917.942591] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.942757] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.942757] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.943150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.943361] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.943566] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 246e69d4-018f-4210-9d5d-c842da84afd4 not found, creating... [ 917.943893] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.944077] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.944238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.944511] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.944687] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.945021] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.945235] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.945372] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.945599] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.945788] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.945909] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 246e69d4-018f-4210-9d5d-c842da84afd4 is going to be created. [ 917.964271] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.964514] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.964586] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.964834] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.965070] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.965298] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.698588] env[70032]: INFO networking_nsxv3.common.synchronization [req-52f039fd-7d68-48f7-a33b-261326cefa95 req-62aa5e3c-50df-402e-b94b-76e3311419d3 service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 918.698872] env[70032]: INFO networking_nsxv3.common.synchronization [req-52f039fd-7d68-48f7-a33b-261326cefa95 req-62aa5e3c-50df-402e-b94b-76e3311419d3 service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 918.698914] env[70032]: INFO networking_nsxv3.common.synchronization [req-52f039fd-7d68-48f7-a33b-261326cefa95 req-62aa5e3c-50df-402e-b94b-76e3311419d3 service nova] Enqueued Resource ID: 246e69d4-018f-4210-9d5d-c842da84afd4 with Priority: HIGHEST for action port [ 918.699504] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 918.699643] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 918.699839] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246e69d4-018f-4210-9d5d-c842da84afd4 with Priority: HIGHEST for action port [ 918.700392] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.700571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.700661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.700926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.701050] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.702021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.702195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.702260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.702438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.702587] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.702684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.702745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.702892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.702978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.703080] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.704268] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-246e69d4-018f-4210-9d5d-c842da84afd4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.704378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.704446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.704597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.704671] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('246e69d4-018f-4210-9d5d-c842da84afd4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.745796] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 918.746825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.746825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.746825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.746825] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.206972] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.207141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.207334] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.208250] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 246e69d4-018f-4210-9d5d-c842da84afd4 with status ACTIVE [ 919.208442] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.208555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.208619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.208815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.208911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.209092] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.209205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.209249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.209402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.209481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.209659] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.209812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.209853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.210017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.210110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.210203] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 246e69d4-018f-4210-9d5d-c842da84afd4 is going to be updated. [ 919.232288] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.232419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.232479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.232664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.232792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.232947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-246e69d4-018f-4210-9d5d-c842da84afd4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.248674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.248800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.696518] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 919.696804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.697039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.697273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.697467] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.697588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.697656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.697804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.697887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.697985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.698089] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.711598] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.110668] env[70032]: INFO networking_nsxv3.common.synchronization [req-d7bd271b-2939-4d99-b1d9-1b235a30b422 req-500ceea7-be1a-4b1a-8838-bf43dd801959 tempest-ListImageFiltersTestJSON-2030612318 tempest-ListImageFiltersTestJSON-2030612318-project-member] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 920.111537] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 920.111863] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.111988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.112086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.112370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.112528] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.112681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.112737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.112892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.112982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.113090] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.200898] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.201060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.201129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.201901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.201901] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.201901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.201901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.203669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.204239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.204357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.204539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.204643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.204708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.204858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.204998] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.205109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.205173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.205311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.205391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.205473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.205562] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.213182] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.213290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.213343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.214937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.214937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.214937] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be created. [ 920.247963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.248116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.248223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.248385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.248536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.258858] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: UNINITIALIZED for 2s [ 920.453565] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.453565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.453565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.453565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.454207] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.454207] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.455473] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.455473] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.455473] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.455473] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.455473] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.455473] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.455769] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.455769] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.455843] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.455988] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.475289] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.475289] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.475388] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.475489] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.475804] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7e26d20d-cb5c-4934-a157-9449461720fe taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.475984] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.476203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.476567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.477020] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e26d20d-cb5c-4934-a157-9449461720fe',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.734368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.734663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.734663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.734790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.734894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.735134] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.735246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.735317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.735489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.735582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.735684] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3034974-c557-4de5-9753-a08e1f169c15 already deleted. [ 920.735811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.736480] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 750167f1-a8ae-4a8e-a9a0-cd5ce2550684: rpc.has_security_group_logging(os_id): False [ 920.755394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.755557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.755642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.755938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.756059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.756277] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.756391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.756466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.756633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.756752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.756976] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.757109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.757185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.757344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.757436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.757633] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.757749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.757818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.757986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.758158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.758261] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 920.816205] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.816356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.816425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.816643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.816792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.828824] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 920.980510] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.980764] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.980897] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.981204] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.981364] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.981525] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7e26d20d-cb5c-4934-a157-9449461720fe not found, creating... [ 920.981793] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.981953] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.982096] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.982315] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.982454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.983070] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.983261] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.983363] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.983575] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.983948] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.983948] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7e26d20d-cb5c-4934-a157-9449461720fe is going to be created. [ 921.005918] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.006170] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.006304] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.006584] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.006812] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.007052] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.730343] env[70032]: INFO networking_nsxv3.common.synchronization [req-d7bd271b-2939-4d99-b1d9-1b235a30b422 req-bc16cbeb-924b-428e-a90f-607fd45e21ad service nova] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_rules [ 921.730474] env[70032]: INFO networking_nsxv3.common.synchronization [req-d7bd271b-2939-4d99-b1d9-1b235a30b422 req-bc16cbeb-924b-428e-a90f-607fd45e21ad service nova] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 921.730617] env[70032]: INFO networking_nsxv3.common.synchronization [req-d7bd271b-2939-4d99-b1d9-1b235a30b422 req-bc16cbeb-924b-428e-a90f-607fd45e21ad service nova] Enqueued Resource ID: 7e26d20d-cb5c-4934-a157-9449461720fe with Priority: HIGHEST for action port [ 921.731292] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_rules [ 921.734430] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 921.734430] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e26d20d-cb5c-4934-a157-9449461720fe with Priority: HIGHEST for action port [ 921.734430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.734430] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.734430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.734430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.734430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.734430] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.735891] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e26d20d-cb5c-4934-a157-9449461720fe taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.735891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.735891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.735891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.735891] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e26d20d-cb5c-4934-a157-9449461720fe',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.236912] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.237106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.237234] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.238071] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e26d20d-cb5c-4934-a157-9449461720fe with status ACTIVE [ 922.238258] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.238416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.238637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.238637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.238784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.238870] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.238966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.239039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.239209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.239329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.239515] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.239607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.239661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.239999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.239999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.239999] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e26d20d-cb5c-4934-a157-9449461720fe is going to be updated. [ 922.259680] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.259922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.259922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.260149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.260213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.260334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e26d20d-cb5c-4934-a157-9449461720fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.268695] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 922.268850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.269255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.269434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.269594] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.269695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.269749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.269892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.270016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.270064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.270172] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.444558] env[70032]: INFO networking_nsxv3.common.synchronization [req-e5001d4f-a369-4921-aaa2-ca41eee27876 req-55339e01-554f-4f5b-a78f-85aac0c918ed tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 922.445087] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 922.445391] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.445512] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.446502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.446502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.446502] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.446502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.446502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.446749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.446749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.446818] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.742609] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.773170] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.773170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.773170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.773404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.774310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.774310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.774310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.774310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.774310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.774310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.774310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.774310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.775157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.775157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.775157] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.775157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.775157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.775157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.775464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.775464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.775464] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.843971] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 922.844219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.950030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.950030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.950223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.950287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.950380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.950589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.950687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.950763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.950998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.951142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.951256] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be deleted. [ 922.971852] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.972058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.972109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.973219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.973219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.973219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.246989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.246989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.246989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.246989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.246989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.246989] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3034974-c557-4de5-9753-a08e1f169c15 is going to be created. [ 923.268264] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.268409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.268474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.268679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.268821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.277246] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1d61d13-44e5-4c83-936b-8a6c378d760a: rpc.has_security_group_logging(os_id): False [ 923.282739] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: UNINITIALIZED for 2s [ 923.295278] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.295391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.295456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.295670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.295819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.296058] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.296462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.296462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.296462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.298029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.298029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.298029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.298029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be created. [ 923.356010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.356552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.356552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.356552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.356755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.372286] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 925.295191] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: SUCCESS [ 925.295191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.295191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.295191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.295543] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.295543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.295543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.295729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.295896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.295944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.296057] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.389312] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 925.389765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.690750] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ec153367-64c8-4d1d-aece-a59d8b2a883f None None] Enqueued Resource ID: 26d661e9-26da-4ae3-bc14-80a0fb0473e9 with Priority: HIGHEST for action port [ 925.691913] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d661e9-26da-4ae3-bc14-80a0fb0473e9 with Priority: HIGHEST for action port [ 925.691913] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d661e9-26da-4ae3-bc14-80a0fb0473e9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.691913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d661e9-26da-4ae3-bc14-80a0fb0473e9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.691913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d661e9-26da-4ae3-bc14-80a0fb0473e9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.692951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d661e9-26da-4ae3-bc14-80a0fb0473e9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.692951] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d661e9-26da-4ae3-bc14-80a0fb0473e9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.799980] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.799980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.799980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.800204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.800367] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.800469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.800532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.800679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.800767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.800854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.801007] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.801105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.801165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.801305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.801438] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.801526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.801585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.801719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.801793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.801873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.801957] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.194731] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26d661e9-26da-4ae3-bc14-80a0fb0473e9 [ 926.194983] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.195217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.195217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.195424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.195522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.195926] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26d661e9-26da-4ae3-bc14-80a0fb0473e9 already deleted. [ 926.195926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d661e9-26da-4ae3-bc14-80a0fb0473e9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.303735] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3034974-c557-4de5-9753-a08e1f169c15: rpc.has_security_group_logging(os_id): False [ 926.321292] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.321581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.322093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.322093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.322093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.322360] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.322460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.322525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.322696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.323129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.323332] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.323457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.323524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.323727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.323834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.324082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.324465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.324465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.324611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.325343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.325611] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3034974-c557-4de5-9753-a08e1f169c15 is going to be created. [ 926.384938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.385065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.385065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.385272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.385461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.397482] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: IN_PROGRESS for 2s [ 926.661836] env[70032]: INFO networking_nsxv3.common.synchronization [req-e6390361-be26-408a-8cb8-6f197a757e94 req-98fe2267-147b-4d47-9061-8e574505bde8 tempest-ListImageFiltersTestJSON-2030612318 tempest-ListImageFiltersTestJSON-2030612318-project-member] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 926.662749] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 926.663594] env[70032]: INFO networking_nsxv3.common.synchronization [None req-877e8d43-4a90-4135-ab4b-bdef8f9de77b tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 926.665010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.665010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.665010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.665010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.665010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.665010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.665010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.665010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.665010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.665010] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.665764] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 926.666199] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.666329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.666329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.666519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.666590] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.835649] env[70032]: INFO networking_nsxv3.common.synchronization [None req-95070d2d-5ebf-4987-932a-ec4aef823a5c tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 926.836362] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 926.836897] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.836897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.168478] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.187671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.187959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.188126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.188417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.188587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.190012] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 already deleted. [ 927.190185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.190413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.190662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.192016] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.227996] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.227996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.227996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.227996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.227996] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.227996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.227996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.227996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.227996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.227996] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.227996] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.227996] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.227996] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.228418] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.228418] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.228418] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.248183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.248365] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.248559] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.248712] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.249241] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-bebc361d-6ab9-45e1-bb1b-e7b57aade089 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.249241] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.249425] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.249765] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.249819] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bebc361d-6ab9-45e1-bb1b-e7b57aade089',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.672509] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.710519] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.710673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.710747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.710959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.711061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.711161] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 already deleted. [ 927.711247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.755024] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.755024] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port bebc361d-6ab9-45e1-bb1b-e7b57aade089 not found, creating... [ 927.755024] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.755024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.755457] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.755457] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.755457] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.755457] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.759024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.759024] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: bebc361d-6ab9-45e1-bb1b-e7b57aade089 is going to be created. [ 927.778467] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.778685] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.778820] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.779114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.779360] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.779613] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.117788] env[70032]: INFO networking_nsxv3.common.synchronization [None req-052f99ca-4fe1-4408-927d-8046efebe77a None None] Enqueued Resource ID: 903db200-6618-4d60-88e8-c1540f3f6bc4 with Priority: HIGHEST for action port [ 928.118055] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 903db200-6618-4d60-88e8-c1540f3f6bc4 with Priority: HIGHEST for action port [ 928.119158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-903db200-6618-4d60-88e8-c1540f3f6bc4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.119158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-903db200-6618-4d60-88e8-c1540f3f6bc4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.119158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-903db200-6618-4d60-88e8-c1540f3f6bc4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.119158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-903db200-6618-4d60-88e8-c1540f3f6bc4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.119158] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('903db200-6618-4d60-88e8-c1540f3f6bc4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.175711] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.175711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.175711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.176026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.176094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.176324] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3034974-c557-4de5-9753-a08e1f169c15 is going to be updated. [ 928.207555] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.207555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.207555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.207555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.207555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.226696] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: IN_PROGRESS for 2s [ 928.409979] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: SUCCESS [ 928.409979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.623194] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 903db200-6618-4d60-88e8-c1540f3f6bc4 [ 928.623729] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.623729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.623729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.625364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.625364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.625364] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:903db200-6618-4d60-88e8-c1540f3f6bc4 already deleted. [ 928.625364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-903db200-6618-4d60-88e8-c1540f3f6bc4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.776352] env[70032]: INFO networking_nsxv3.common.synchronization [req-e6390361-be26-408a-8cb8-6f197a757e94 req-44679a6a-e66d-4728-82e8-afbcbebd1d93 service nova] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_rules [ 928.776574] env[70032]: INFO networking_nsxv3.common.synchronization [req-e6390361-be26-408a-8cb8-6f197a757e94 req-44679a6a-e66d-4728-82e8-afbcbebd1d93 service nova] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 928.776676] env[70032]: INFO networking_nsxv3.common.synchronization [req-e6390361-be26-408a-8cb8-6f197a757e94 req-44679a6a-e66d-4728-82e8-afbcbebd1d93 service nova] Enqueued Resource ID: bebc361d-6ab9-45e1-bb1b-e7b57aade089 with Priority: HIGHEST for action port [ 928.777719] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_rules [ 928.777860] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 928.777958] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bebc361d-6ab9-45e1-bb1b-e7b57aade089 with Priority: HIGHEST for action port [ 928.778671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.778671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.778775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.778904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.778987] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.779852] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.779952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.780166] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-bebc361d-6ab9-45e1-bb1b-e7b57aade089 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.780269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.780336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.780508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.780581] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bebc361d-6ab9-45e1-bb1b-e7b57aade089',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.790184] env[70032]: INFO networking_nsxv3.common.synchronization [None req-2f81f614-0cfb-4554-82f2-fb5f061f9740 None None] Enqueued Resource ID: 22873e15-6dac-4fc1-9a30-0d731bd95dbd with Priority: HIGHEST for action port [ 928.790184] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22873e15-6dac-4fc1-9a30-0d731bd95dbd with Priority: HIGHEST for action port [ 928.790184] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-22873e15-6dac-4fc1-9a30-0d731bd95dbd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.790184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22873e15-6dac-4fc1-9a30-0d731bd95dbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.790184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22873e15-6dac-4fc1-9a30-0d731bd95dbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.790184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22873e15-6dac-4fc1-9a30-0d731bd95dbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.790184] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22873e15-6dac-4fc1-9a30-0d731bd95dbd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.178465] env[70032]: INFO networking_nsxv3.common.synchronization [None req-a32423d6-8906-4d30-b0b3-fd3b24b18439 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: 2059c6fe-169d-48ce-b270-c33ebfb0bce4 with Priority: HIGHEST for action security_group_rules [ 929.178963] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2059c6fe-169d-48ce-b270-c33ebfb0bce4 with Priority: HIGHEST for action security_group_rules [ 929.179792] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.179792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.179792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.179792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.179792] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2059c6fe-169d-48ce-b270-c33ebfb0bce4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.271765] env[70032]: INFO networking_nsxv3.common.synchronization [None req-70f174ae-2838-421c-b555-43edbfb6b7e4 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: 2059c6fe-169d-48ce-b270-c33ebfb0bce4 with Priority: HIGHEST for action security_group_rules [ 929.272396] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2059c6fe-169d-48ce-b270-c33ebfb0bce4 with Priority: HIGHEST for action security_group_rules [ 929.272750] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.272857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.286774] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bebc361d-6ab9-45e1-bb1b-e7b57aade089 with status ACTIVE [ 929.287770] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.287770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.287770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.287770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.287770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.288151] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.288151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.288151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.288288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.288370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.288561] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.289573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.289656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.289810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.290156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.290156] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bebc361d-6ab9-45e1-bb1b-e7b57aade089 is going to be updated. [ 929.291604] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.291704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.293913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22873e15-6dac-4fc1-9a30-0d731bd95dbd [ 929.293997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.294102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.294211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.294314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.294737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.294737] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22873e15-6dac-4fc1-9a30-0d731bd95dbd already deleted. [ 929.294737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22873e15-6dac-4fc1-9a30-0d731bd95dbd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.315119] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.315119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.315119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.315717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.315717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.315717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bebc361d-6ab9-45e1-bb1b-e7b57aade089" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.702448] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.702448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.702448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.702448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.702768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.702768] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2059c6fe-169d-48ce-b270-c33ebfb0bce4 already deleted. [ 929.702768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.702890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.702966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.703065] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2059c6fe-169d-48ce-b270-c33ebfb0bce4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.242026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: SUCCESS [ 930.242026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.242897] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.243076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.243189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.243421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.243534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.243656] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2059c6fe-169d-48ce-b270-c33ebfb0bce4 already deleted. [ 930.243789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2059c6fe-169d-48ce-b270-c33ebfb0bce4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.243990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.244202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.244386] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.244517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.244653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.244768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.244870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.244986] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.747372] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.139662] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f368547d-fb5b-4a81-8191-b8771136a2e8 None None] Enqueued Resource ID: 8884853d-3964-41b0-a96d-8d79fc379153 with Priority: HIGHEST for action port [ 931.139932] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8884853d-3964-41b0-a96d-8d79fc379153 with Priority: HIGHEST for action port [ 931.140498] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-8884853d-3964-41b0-a96d-8d79fc379153 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.140612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8884853d-3964-41b0-a96d-8d79fc379153" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.140673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8884853d-3964-41b0-a96d-8d79fc379153" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.140951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8884853d-3964-41b0-a96d-8d79fc379153" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.141091] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8884853d-3964-41b0-a96d-8d79fc379153',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.249433] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.643039] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8884853d-3964-41b0-a96d-8d79fc379153 [ 931.643333] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.643418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.643490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.644033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.644033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.644033] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8884853d-3964-41b0-a96d-8d79fc379153 already deleted. [ 931.645122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8884853d-3964-41b0-a96d-8d79fc379153" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.751915] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.752430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.752530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.753084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.753084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.753084] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3034974-c557-4de5-9753-a08e1f169c15 is going to be updated. [ 931.784394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.784394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.784394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.784394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.784761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.792542] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: IN_PROGRESS for 2s [ 933.358241] env[70032]: INFO networking_nsxv3.common.synchronization [req-c44d54c6-1e1c-4029-a5c6-6e2e32a027ce req-c4b96870-acc0-4bf6-8a4e-a4733f75f103 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_members [ 933.358779] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGHEST for action security_group_members [ 933.359115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.359230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.359293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.359495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.359640] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.359726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.359786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.359924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.360013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.360245] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.804976] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: SUCCESS [ 933.805036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.805885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.805885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.805885] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.805885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.805885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.806118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.806118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.806118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.806216] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.862346] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.862529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.862614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.862863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.862995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.863185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.863284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.863345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.863499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.863573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.863657] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 is going to be updated. [ 933.889727] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.889881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.889951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.890185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.890320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.898410] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: IN_PROGRESS for 2s [ 934.309342] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.309524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.309585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.309810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.309981] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.310120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.310187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.310339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.310425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.310514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.310667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.310754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.310803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.310943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.311093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.311185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.311245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.311380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.311456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.311536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.311625] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.814427] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3034974-c557-4de5-9753-a08e1f169c15: rpc.has_security_group_logging(os_id): False [ 934.838351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.838351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.838545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.838614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.838703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.838933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.839066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.839130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.839283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.839353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.839535] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.839627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.839687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.839840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.839974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.840171] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.840264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.840317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.840453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.840527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.840613] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3034974-c557-4de5-9753-a08e1f169c15 is going to be updated. [ 934.907479] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.907479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.907479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.907741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.907741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.924147] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: IN_PROGRESS for 2s [ 935.908584] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 in Status: SUCCESS [ 935.908869] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 deletion is rescheduled due to dependency. [ 935.908968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.939061] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: SUCCESS [ 936.939520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.359758] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 938.359980] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 939.233169] env[70032]: INFO networking_nsxv3.common.synchronization [req-98fda5c5-45d7-4903-8f52-cbf2e1a8311d req-f09670f7-1f5a-43e4-b96d-f73e34205a84 tempest-ServersNegativeTestMultiTenantJSON-1144469946 tempest-ServersNegativeTestMultiTenantJSON-1144469946-project-member] Enqueued Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_members [ 939.235046] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_members [ 939.235046] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.235046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.235046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.235046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.235046] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.235046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.235046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.235572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.235572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.235572] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.597067] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.597814] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-827" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.598144] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-827" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.598691] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-827" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.599134] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.599432] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.599671] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.599986] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.600261] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.600899] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.600899] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.600899] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.600899] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.601056] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.601130] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.601257] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.621227] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.621423] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.621566] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.621755] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-827" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.622092] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-4a67c728-a551-496f-91c2-5d04feefce7d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.622272] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.622397] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.622726] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.622872] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a67c728-a551-496f-91c2-5d04feefce7d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.739820] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.740096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.740234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.743577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.743577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.743577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.743577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.743577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.743577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.743577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.743577] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f already deleted. [ 939.743577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.126040] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.126040] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.126040] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.126321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.126475] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.126637] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 4a67c728-a551-496f-91c2-5d04feefce7d not found, creating... [ 940.126950] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.127183] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.127331] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.127560] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.127706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.128099] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.128202] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.128363] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.128534] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.128676] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.128820] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 4a67c728-a551-496f-91c2-5d04feefce7d is going to be created. [ 940.156545] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.156788] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.156956] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.157271] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.157526] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.157760] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.951276] env[70032]: INFO networking_nsxv3.common.synchronization [req-98fda5c5-45d7-4903-8f52-cbf2e1a8311d req-670801d1-b21e-4cc2-88b2-a79d8c4cec1a service nova] Enqueued Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_rules [ 940.951522] env[70032]: INFO networking_nsxv3.common.synchronization [req-98fda5c5-45d7-4903-8f52-cbf2e1a8311d req-670801d1-b21e-4cc2-88b2-a79d8c4cec1a service nova] Enqueued Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_members [ 940.951618] env[70032]: INFO networking_nsxv3.common.synchronization [req-98fda5c5-45d7-4903-8f52-cbf2e1a8311d req-670801d1-b21e-4cc2-88b2-a79d8c4cec1a service nova] Enqueued Resource ID: 4a67c728-a551-496f-91c2-5d04feefce7d with Priority: HIGHEST for action port [ 940.952232] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_rules [ 940.952385] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_members [ 940.952465] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a67c728-a551-496f-91c2-5d04feefce7d with Priority: HIGHEST for action port [ 940.954287] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27ec5bcd-a30c-4400-8500-5f69d46c0d4f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.954443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.954520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.954782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.954885] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.955790] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.955929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.956103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.956220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.956433] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.956477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.956636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.956696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.956764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.956852] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.957657] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a67c728-a551-496f-91c2-5d04feefce7d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.957765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.957839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.957989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.958069] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a67c728-a551-496f-91c2-5d04feefce7d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.459983] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.460143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.460340] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a67c728-a551-496f-91c2-5d04feefce7d with status ACTIVE [ 941.460517] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.460625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.460684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.460905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.461008] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.462394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.462522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.462595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.462785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.462880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.463148] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.463265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.463314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.463451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.463533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.463623] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a67c728-a551-496f-91c2-5d04feefce7d is going to be updated. [ 941.464830] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.484177] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.484320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.484371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.484573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.484711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.484869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a67c728-a551-496f-91c2-5d04feefce7d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.968239] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.470795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.470975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.471061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.471287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.471383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.471487] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f is going to be created. [ 942.494712] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.494712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.494905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.495064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.495260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.503957] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f in Status: UNINITIALIZED for 2s [ 944.044053] env[70032]: INFO networking_nsxv3.common.synchronization [req-d082833d-1a44-4060-aad6-bdd1225afcdc req-0fd8c53e-47ec-40bc-bcbb-34031eb8d230 tempest-ListServerFiltersTestJSON-951974945 tempest-ListServerFiltersTestJSON-951974945-project-member] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 944.044685] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 944.045054] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.045214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.045294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.046419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.046681] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.046874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.047010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.047264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.047358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.047463] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.399625] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-447 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.399839] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.399966] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.400323] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.400596] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.401353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.401353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.401353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.401353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.401464] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.401598] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.401666] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.401732] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.401916] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.401963] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.402527] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.421405] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.421567] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 944.421703] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.421881] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.422434] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-562a6781-ed23-4110-9a72-98ce7d170603 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.422671] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.422798] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.423160] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.423300] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('562a6781-ed23-4110-9a72-98ce7d170603',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.514305] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f in Status: SUCCESS [ 944.514547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.514859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.515258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.515554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.515690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.515768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.515964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.516064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.516957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.516957] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.550239] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.550489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.550489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.551170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.551170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.551250] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.551315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.551883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.551883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.551883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.551883] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 already deleted. [ 944.551883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.926266] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.926266] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.926634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.929115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.929115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.929115] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 562a6781-ed23-4110-9a72-98ce7d170603 not found, creating... [ 944.929115] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.929115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.929115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.929115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.929115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.929115] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.929561] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.929849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.930445] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.931107] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.931107] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 562a6781-ed23-4110-9a72-98ce7d170603 is going to be created. [ 944.955612] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.955612] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.955733] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.956967] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.956967] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.956967] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.020657] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.020830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.020904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.021128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.021299] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.021398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.021458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.021601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.021687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.021772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.021929] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.022072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.022138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.022303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.022471] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.022587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.022676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.023253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.023253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.023253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.023253] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.525630] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27ec5bcd-a30c-4400-8500-5f69d46c0d4f: rpc.has_security_group_logging(os_id): False [ 945.544743] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.544743] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.544743] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.544743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.546219] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.546881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.547099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.547335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.547496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.547660] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f is going to be created. [ 945.605054] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.605054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.605054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.605054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.605054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.614908] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f in Status: IN_PROGRESS for 2s [ 945.657775] env[70032]: INFO networking_nsxv3.common.synchronization [req-d082833d-1a44-4060-aad6-bdd1225afcdc req-2549514b-25f1-445f-8332-2550fd3c2da2 service nova] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_rules [ 945.660557] env[70032]: INFO networking_nsxv3.common.synchronization [req-d082833d-1a44-4060-aad6-bdd1225afcdc req-2549514b-25f1-445f-8332-2550fd3c2da2 service nova] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 945.660557] env[70032]: INFO networking_nsxv3.common.synchronization [req-d082833d-1a44-4060-aad6-bdd1225afcdc req-2549514b-25f1-445f-8332-2550fd3c2da2 service nova] Enqueued Resource ID: 562a6781-ed23-4110-9a72-98ce7d170603 with Priority: HIGHEST for action port [ 945.660557] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_rules [ 945.660557] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 945.660557] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562a6781-ed23-4110-9a72-98ce7d170603 with Priority: HIGHEST for action port [ 945.660557] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.660557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.660557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.661061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.661251] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.662535] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.662786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.662943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.663206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.663450] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.663640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.665018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.665018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.665018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.665018] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.665907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-562a6781-ed23-4110-9a72-98ce7d170603 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.666108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.666178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.666344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.666461] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('562a6781-ed23-4110-9a72-98ce7d170603',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.167742] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.168901] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.169035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.169305] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 562a6781-ed23-4110-9a72-98ce7d170603 with status ACTIVE [ 946.169473] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.169580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.169646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.169852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.169944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.170140] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.170242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.170433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.170433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.170529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.170747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.170747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.170838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.170949] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.171032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.171122] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 562a6781-ed23-4110-9a72-98ce7d170603 is going to be updated. [ 946.191401] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.191577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.191616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.191797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.191925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.192095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-562a6781-ed23-4110-9a72-98ce7d170603" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.670571] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.173412] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.173583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.173773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.174022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.174113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.174203] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be created. [ 947.182043] env[70032]: INFO networking_nsxv3.common.synchronization [req-fb9bb115-6d3f-4553-bbcc-bf38cb2232c4 req-96e5f515-653c-4f28-8a99-0c33a7f04695 tempest-ListServerFiltersTestJSON-951974945 tempest-ListServerFiltersTestJSON-951974945-project-member] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 947.182664] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 947.182983] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.183110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.203831] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.203831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.203831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.203831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.203831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.214262] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: UNINITIALIZED for 2s [ 947.547426] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-447 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.547636] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.547780] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.548100] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.548498] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.548638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.548754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.548994] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.549171] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.549382] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.549498] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.549610] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.549720] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.549851] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.550012] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.550190] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.568791] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.568951] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.569167] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.569362] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.569682] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.569865] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.570022] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.570398] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.570565] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.627714] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f in Status: SUCCESS [ 947.627714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.075214] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.075214] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.075214] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.075590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.075590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.075692] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df not found, creating... [ 948.075984] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.076222] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.076344] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.076566] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.076777] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.077155] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.077338] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.077465] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.077750] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.077936] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.078096] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df is going to be created. [ 948.099832] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.100079] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.100290] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.100598] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.100847] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.101101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.870248] env[70032]: INFO networking_nsxv3.common.synchronization [req-fb9bb115-6d3f-4553-bbcc-bf38cb2232c4 req-0b3f74af-901d-4e87-997f-2531393859ed service nova] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_rules [ 948.870538] env[70032]: INFO networking_nsxv3.common.synchronization [req-fb9bb115-6d3f-4553-bbcc-bf38cb2232c4 req-0b3f74af-901d-4e87-997f-2531393859ed service nova] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 948.870685] env[70032]: INFO networking_nsxv3.common.synchronization [req-fb9bb115-6d3f-4553-bbcc-bf38cb2232c4 req-0b3f74af-901d-4e87-997f-2531393859ed service nova] Enqueued Resource ID: a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df with Priority: HIGHEST for action port [ 948.871287] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_rules [ 948.871447] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 948.871579] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df with Priority: HIGHEST for action port [ 948.871930] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.873986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.874260] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.874360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.877262] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.877262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.877262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.877262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.877262] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.226308] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 949.226586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.226737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.226954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.227158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.227276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.227331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.227487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.227565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.227648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.227766] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.228653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.228816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.228970] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.229079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.229166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.229361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.229448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.229523] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.377923] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df with status ACTIVE [ 949.377923] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.377923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.377923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.378434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.378434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.378643] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.378751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.378813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.378998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.379105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.379311] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.379485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.379485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.379653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.379713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.379786] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df is going to be updated. [ 949.399769] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.399769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.399769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.400205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.400205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.400459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9d7ee72-a4f1-4e4c-a54f-9c13e2d891df" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.731773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.731953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.734243] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.237051] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.739591] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.739909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.739909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.740119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.740210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.740316] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 950.769641] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.769641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.769641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.769641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.769896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.778866] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 951.780166] env[70032]: INFO networking_nsxv3.common.synchronization [req-31ea9d09-75bc-49c7-a50f-d5bdf0e2fea1 req-6c6e6b82-dca2-43f0-9dd8-b82d51818019 tempest-ServersNegativeTestMultiTenantJSON-1144469946 tempest-ServersNegativeTestMultiTenantJSON-1144469946-project-member] Enqueued Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_members [ 951.784030] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f with Priority: HIGHEST for action security_group_members [ 951.784030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.784030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.784030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.784030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.784030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.784030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.784579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.784904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.785590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.785826] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27ec5bcd-a30c-4400-8500-5f69d46c0d4f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.288265] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.288483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.288609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.288815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.288914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.289267] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.289386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.289444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.289635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.289741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.289855] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f is going to be updated. [ 952.320110] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.320110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.320110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.320110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.320441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.329423] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f in Status: IN_PROGRESS for 2s [ 952.788408] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 952.788859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.788859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.789089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.789187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.789308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.789369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.789547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.789628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.789723] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.293072] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.782363] env[70032]: INFO networking_nsxv3.common.synchronization [req-97a48539-f5d4-42fa-a5f1-47d2cbf3cfed req-b5c65659-4d91-42f3-bd2c-2997f2ed9aa5 tempest-ListServerFiltersTestJSON-951974945 tempest-ListServerFiltersTestJSON-951974945-project-member] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 953.782953] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 953.783303] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.783422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.794548] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.124921] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-447 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.125149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.125285] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.125616] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.125818] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.125983] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.126292] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.126709] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.126809] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.127166] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.127314] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.127602] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.127675] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.127859] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.128046] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.128427] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.147384] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.147907] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.148150] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.148419] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-447" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.148819] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-3fdaf06d-d9f0-4c07-a1f9-35b750042007 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.148980] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.149099] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.149474] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.149843] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fdaf06d-d9f0-4c07-a1f9-35b750042007',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.297273] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.297273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.297273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.297480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.297576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.297679] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 954.324585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.324733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.325514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.325514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.325514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.333733] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 954.335833] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f in Status: SUCCESS [ 954.336056] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27ec5bcd-a30c-4400-8500-5f69d46c0d4f deletion is rescheduled due to dependency. [ 954.336153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27ec5bcd-a30c-4400-8500-5f69d46c0d4f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.654026] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.654026] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.654026] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.654026] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.654026] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.654026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 3fdaf06d-d9f0-4c07-a1f9-35b750042007 not found, creating... [ 954.654581] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.655044] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.655385] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.656106] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.656861] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.658155] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.659268] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.659445] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.659718] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.659872] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.660043] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 3fdaf06d-d9f0-4c07-a1f9-35b750042007 is going to be created. [ 954.679642] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.679855] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.679980] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.680360] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.680759] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.680851] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.708305] env[70032]: INFO networking_nsxv3.common.synchronization [req-97a48539-f5d4-42fa-a5f1-47d2cbf3cfed req-5bbfac49-5741-469f-890b-a03908b4d4a8 service nova] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_rules [ 955.708634] env[70032]: INFO networking_nsxv3.common.synchronization [req-97a48539-f5d4-42fa-a5f1-47d2cbf3cfed req-5bbfac49-5741-469f-890b-a03908b4d4a8 service nova] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 955.708634] env[70032]: INFO networking_nsxv3.common.synchronization [req-97a48539-f5d4-42fa-a5f1-47d2cbf3cfed req-5bbfac49-5741-469f-890b-a03908b4d4a8 service nova] Enqueued Resource ID: 3fdaf06d-d9f0-4c07-a1f9-35b750042007 with Priority: HIGHEST for action port [ 955.708863] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_rules [ 955.708989] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 955.709126] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdaf06d-d9f0-4c07-a1f9-35b750042007 with Priority: HIGHEST for action port [ 955.709684] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.709797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.710827] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.710920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.711201] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fdaf06d-d9f0-4c07-a1f9-35b750042007 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.711327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.711391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.711594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.711739] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fdaf06d-d9f0-4c07-a1f9-35b750042007',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.731173] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1480cf04-d1c8-4abe-ac41-b8c9f430017b None None] Enqueued Resource ID: 9a410c2a-5030-4507-8936-394cde48a2fd with Priority: HIGHEST for action port [ 955.731455] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a410c2a-5030-4507-8936-394cde48a2fd with Priority: HIGHEST for action port [ 955.731959] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a410c2a-5030-4507-8936-394cde48a2fd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.732107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a410c2a-5030-4507-8936-394cde48a2fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.732163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a410c2a-5030-4507-8936-394cde48a2fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.732403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a410c2a-5030-4507-8936-394cde48a2fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.732488] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a410c2a-5030-4507-8936-394cde48a2fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.214252] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fdaf06d-d9f0-4c07-a1f9-35b750042007 with status ACTIVE [ 956.214410] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.214553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.214631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.214828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.214918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.215108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.215213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.215266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.215420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.215497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.215677] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.215768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.215828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.215965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.216076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.216166] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fdaf06d-d9f0-4c07-a1f9-35b750042007 is going to be updated. [ 956.236460] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a410c2a-5030-4507-8936-394cde48a2fd [ 956.236698] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.236830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.236896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.237261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.237362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.237469] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a410c2a-5030-4507-8936-394cde48a2fd already deleted. [ 956.237551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a410c2a-5030-4507-8936-394cde48a2fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.238781] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.238896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.238963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.239242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.239318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.239645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fdaf06d-d9f0-4c07-a1f9-35b750042007" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.345584] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 956.347060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.347060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.347060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.347060] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.347060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.347060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.347060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.347409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.347409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.347905] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.348071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.350344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.350344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.350344] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.350344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.350344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.350344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.350344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.350344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.350344] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.350681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.350777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.351013] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.351655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.351754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.351950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.352030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.352197] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.414865] env[70032]: INFO networking_nsxv3.common.synchronization [None req-0d25a627-98d4-46be-be27-a2cc1e7e9d99 tempest-ServerActionsV293TestJSON-1016486754 tempest-ServerActionsV293TestJSON-1016486754-project-member] Enqueued Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_rules [ 956.415407] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_rules [ 956.415723] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.415822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.419211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.419499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.419605] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.537876] env[70032]: INFO networking_nsxv3.common.synchronization [None req-58d62aa7-9481-455f-b661-8bdc9e6667c9 tempest-ServerActionsV293TestJSON-1016486754 tempest-ServerActionsV293TestJSON-1016486754-project-member] Enqueued Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_rules [ 956.538485] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_rules [ 956.538792] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.538873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.576108] env[70032]: INFO networking_nsxv3.common.synchronization [req-0893ebea-b2d8-4240-9277-c4cb8dad62ad req-a8778042-a36d-4c5d-a639-3cc3e5db7d9b tempest-ServersNegativeTestJSON-1561012911 tempest-ServersNegativeTestJSON-1561012911-project-member] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 956.577232] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 956.577558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.577683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.577754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.578012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.578176] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.578278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.578341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.578495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.578576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.578672] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.854552] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d217ae0-b74a-4bed-9ca6-45df455c7a58: rpc.has_security_group_logging(os_id): False [ 956.855833] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.875719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.879040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.879040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.879040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.879493] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.879493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.879493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.879493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.879493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.879493] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be created. [ 956.942112] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.942112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.942112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.942112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.942112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.942112] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c991b17e-e013-4122-96ca-aa291400f826 already deleted. [ 956.942112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.942112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.942112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.942112] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.947541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.949649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.949649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.949649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.949649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.958096] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 957.083702] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.083861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.083973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.084180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.084275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.084483] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.084584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.084645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.084797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.084871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.084956] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf already deleted. [ 957.085047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.150140] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.150458] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.150611] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.151271] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.151271] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.151395] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.151544] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.151768] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.151936] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.152240] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.152355] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.152489] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.152614] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.152743] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.152865] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.153097] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.172296] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.172296] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.172433] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.172630] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.172949] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.173177] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.173271] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.173568] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.173711] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6c601a8-43f4-4a1a-80fa-28f29692dfa1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.361832] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.461157] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.461330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.461391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.461812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.461812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.461812] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c991b17e-e013-4122-96ca-aa291400f826 already deleted. [ 957.461933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.677410] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.678089] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.678089] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.678153] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.678376] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.679149] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port c6c601a8-43f4-4a1a-80fa-28f29692dfa1 not found, creating... [ 957.679149] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.679149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.679149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.679335] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.680011] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.680403] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.680620] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.681209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.681321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.681713] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.681713] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 is going to be created. [ 957.703325] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.703641] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.703789] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.704107] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.704392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.704589] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.848298] env[70032]: INFO networking_nsxv3.common.synchronization [None req-6efa68b6-9133-49f0-939b-9e80b99dcfe3 None None] Enqueued Resource ID: 00503abc-604b-4bb0-91aa-47d6ddd3ce19 with Priority: HIGHEST for action port [ 957.848840] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00503abc-604b-4bb0-91aa-47d6ddd3ce19 with Priority: HIGHEST for action port [ 957.849570] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-00503abc-604b-4bb0-91aa-47d6ddd3ce19 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.849715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00503abc-604b-4bb0-91aa-47d6ddd3ce19" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.849786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00503abc-604b-4bb0-91aa-47d6ddd3ce19" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.851076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00503abc-604b-4bb0-91aa-47d6ddd3ce19" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.851076] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00503abc-604b-4bb0-91aa-47d6ddd3ce19',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.864713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.865027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.865027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.865174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.865269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.865924] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 957.897260] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.897405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.897476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.897694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.897828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.909030] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 958.353686] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00503abc-604b-4bb0-91aa-47d6ddd3ce19 [ 958.353686] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.353686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.353686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.353686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.353686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.353686] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00503abc-604b-4bb0-91aa-47d6ddd3ce19 already deleted. [ 958.353686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00503abc-604b-4bb0-91aa-47d6ddd3ce19" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.615174] env[70032]: INFO networking_nsxv3.common.synchronization [req-0893ebea-b2d8-4240-9277-c4cb8dad62ad req-68ce5f8a-1eab-44f3-8ef6-481bf24f08f3 service nova] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_rules [ 958.615377] env[70032]: INFO networking_nsxv3.common.synchronization [req-0893ebea-b2d8-4240-9277-c4cb8dad62ad req-68ce5f8a-1eab-44f3-8ef6-481bf24f08f3 service nova] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 958.615525] env[70032]: INFO networking_nsxv3.common.synchronization [req-0893ebea-b2d8-4240-9277-c4cb8dad62ad req-68ce5f8a-1eab-44f3-8ef6-481bf24f08f3 service nova] Enqueued Resource ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 with Priority: HIGHEST for action port [ 958.616247] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_rules [ 958.616247] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 958.616247] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 with Priority: HIGHEST for action port [ 958.616749] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.616749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.616749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.617156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.617263] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.618140] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.618302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.618493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.618709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.618907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.619045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.619139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.620261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.620261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.620261] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.620261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.620830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.620830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.620830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.620830] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6c601a8-43f4-4a1a-80fa-28f29692dfa1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.970894] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 958.971216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.971383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.971594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.971684] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.122944] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.124197] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.124330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.125143] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6c601a8-43f4-4a1a-80fa-28f29692dfa1 with status ACTIVE [ 959.125143] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.125143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.125143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.125143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.125385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.125385] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.125627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.125627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.125738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.125835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.126084] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.126216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.126282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.126464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.126563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.126789] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 is going to be updated. [ 959.146230] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.146398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.146460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.146662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.146794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.146947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.474234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.475050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.629124] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.932031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 959.932031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.932797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.933247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.933460] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.933593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.933652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.933814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.933916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.934034] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.138072] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.138380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.138380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.139168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.139168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.139168] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be created. [ 960.161322] env[70032]: INFO networking_nsxv3.common.synchronization [req-7f5e408b-8438-490d-8312-d7c14987d00a req-98dbb7f9-c458-4bea-ae44-7f2ccd6b0947 tempest-InstanceActionsV221TestJSON-507302934 tempest-InstanceActionsV221TestJSON-507302934-project-member] Enqueued Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_members [ 960.162721] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_members [ 960.162847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a60e0c43-f06a-467e-816b-4e256badc10b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.163282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.163282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.163494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.163667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.163786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.163849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.164147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.164276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.164336] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.170185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.170185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.170185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.170185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.170185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.186327] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: UNINITIALIZED for 2s [ 960.436853] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.592499] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.592778] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-41" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.592954] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-41" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.593359] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-41" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.593925] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.593925] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.593925] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.594222] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.594265] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.594482] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.594604] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.594993] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.594993] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.594993] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.595274] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.595274] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.618268] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.618499] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.618677] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.618885] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-41" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.619223] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7718c271-bfa6-4077-ae28-d3aee274dd13 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.619446] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.619509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.620079] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.620079] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7718c271-bfa6-4077-ae28-d3aee274dd13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.667516] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.667702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.667833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.668111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.668211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.668422] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.668509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.668642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.668790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.668889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.668985] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a60e0c43-f06a-467e-816b-4e256badc10b already deleted. [ 960.669084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.942292] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.123078] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.123307] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.123474] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.123822] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.124166] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.124286] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7718c271-bfa6-4077-ae28-d3aee274dd13 not found, creating... [ 961.124617] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.124845] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.124913] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.125182] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.125334] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.125628] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.125789] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.125910] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.126183] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.126332] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.126483] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7718c271-bfa6-4077-ae28-d3aee274dd13 is going to be created. [ 961.147130] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.147521] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.147521] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.147756] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.147986] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.148268] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.444763] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.445053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.445208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.445468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.445591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.445720] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 961.472397] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.472563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.472563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.472786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.472935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.481644] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 961.863464] env[70032]: INFO networking_nsxv3.common.synchronization [req-7f5e408b-8438-490d-8312-d7c14987d00a req-67ffb793-fc6b-40f0-bdcd-4e77baaa7666 service nova] Enqueued Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_rules [ 961.863646] env[70032]: INFO networking_nsxv3.common.synchronization [req-7f5e408b-8438-490d-8312-d7c14987d00a req-67ffb793-fc6b-40f0-bdcd-4e77baaa7666 service nova] Enqueued Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_members [ 961.863860] env[70032]: INFO networking_nsxv3.common.synchronization [req-7f5e408b-8438-490d-8312-d7c14987d00a req-67ffb793-fc6b-40f0-bdcd-4e77baaa7666 service nova] Enqueued Resource ID: 7718c271-bfa6-4077-ae28-d3aee274dd13 with Priority: HIGHEST for action port [ 961.864378] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_rules [ 961.864441] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_members [ 961.864534] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7718c271-bfa6-4077-ae28-d3aee274dd13 with Priority: HIGHEST for action port [ 961.864872] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a60e0c43-f06a-467e-816b-4e256badc10b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.864956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.865478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.865882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.865978] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.866951] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a60e0c43-f06a-467e-816b-4e256badc10b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.866951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.867055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.867198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.867371] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.867517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.867517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.868285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.868363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.868455] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.869194] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7718c271-bfa6-4077-ae28-d3aee274dd13 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.869589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.869692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.869855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.869934] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7718c271-bfa6-4077-ae28-d3aee274dd13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.198051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 962.198366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.198469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.198688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.198876] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.199072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.199176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.199354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.199463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.199571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.199682] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.372031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a60e0c43-f06a-467e-816b-4e256badc10b taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.372031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.372031] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.372939] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7718c271-bfa6-4077-ae28-d3aee274dd13 with status ACTIVE [ 962.373147] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.373264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.373348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.373547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.373686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.373808] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.373907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.373974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.374161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.374246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.374911] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.374911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.374911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.374911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.374911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.374911] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7718c271-bfa6-4077-ae28-d3aee274dd13 is going to be updated. [ 962.394277] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.394427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.394496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.394691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.394820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.394976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7718c271-bfa6-4077-ae28-d3aee274dd13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.703019] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.703019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.703019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.703019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.703019] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.703019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.703339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.703339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.703339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.703412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.703548] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.703636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.703694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.703829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.704012] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.704137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.704196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.704332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.704404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.704479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.704563] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.877641] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.207406] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bccc08ea-f041-453a-b54a-615933f6cecf: rpc.has_security_group_logging(os_id): False [ 963.225377] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.225545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.225598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.225996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.226146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.226373] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.226497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.226563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.226721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.226800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.226979] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.227152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.227152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.227299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.227359] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.227554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.228168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.228168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.228168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.228168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.228168] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be created. [ 963.279415] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.279588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.279638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.279836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.280043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.288993] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 963.381866] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.382049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.382118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.382339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.382434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.382535] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a60e0c43-f06a-467e-816b-4e256badc10b is going to be created. [ 963.407695] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.407841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.407913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.408147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.408308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.418019] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a60e0c43-f06a-467e-816b-4e256badc10b in Status: UNINITIALIZED for 2s [ 963.490949] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 963.491275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.491496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.491754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.491962] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.492100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.492190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.492379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.492486] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.492601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.492710] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.997017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.997017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.997017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.997017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.997558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.997558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.997558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.997558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.997558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.997685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.997767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.997850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.997971] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.501754] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d217ae0-b74a-4bed-9ca6-45df455c7a58: rpc.has_security_group_logging(os_id): False [ 964.517598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.517794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.517876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.518106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.518206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.518422] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.518529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.518598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.518740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.518817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.519024] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.519122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.519185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.519341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.519417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.519597] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.519688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.519750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.519886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.519959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.520173] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 964.578041] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.578187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.578187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.578374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.578521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.601942] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 964.980376] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-f37e5417-a37c-4516-8a2c-dc8d05ee8031 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 964.980376] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 964.980774] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.981116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.981281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.981675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.981939] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.982175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.982325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.982570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.982734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.982901] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.304578] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 965.304578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.386795] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-930c5929-6b0b-40f8-8626-441d73f921a9 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 965.386795] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 965.386795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.386795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.428853] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a60e0c43-f06a-467e-816b-4e256badc10b in Status: SUCCESS [ 965.428853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.428853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.429051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.429179] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.429407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.429407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.429623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.429623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.429729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.429729] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.486055] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.486276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.486339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.486630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.486739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.486963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.487135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.487240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.487473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.487560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.487652] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 already deleted. [ 965.487728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.487925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.488144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.488243] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.488383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.488574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.488679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.488794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.488923] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.836662] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-1b7250cc-50c3-46f7-83c6-deecb04b0429 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 965.837281] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 965.837603] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.837704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.932608] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a60e0c43-f06a-467e-816b-4e256badc10b taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.933012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.933107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.933348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.933558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.933699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.933792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.934016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.934164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.934300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.934626] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a60e0c43-f06a-467e-816b-4e256badc10b taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.934626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.934626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.937574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.937652] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.937835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.937944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.938140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.938261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.938381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.938484] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.993052] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.993517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.993517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.993517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.993657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.993787] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.993957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.993957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.994107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.994185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.994270] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 already deleted. [ 965.994351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.994531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.994945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.994945] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.994945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.995140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.995170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.995292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.995324] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.228217] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.228217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.228217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.228217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.228523] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.228523] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.228615] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.229567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.229567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.229567] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.229567] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.229567] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.229567] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.229796] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.229796] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.229846] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.250556] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.250743] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.250892] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.251087] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.251405] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.251754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.251754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.252042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.252191] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('707d887d-60f8-4dd4-b3f3-5d5c207cb4fe',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.440821] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a60e0c43-f06a-467e-816b-4e256badc10b: rpc.has_security_group_logging(os_id): False [ 966.460315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.460931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.460931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.460931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.460931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.461159] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.461234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.461234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.461403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.463590] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.463590] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.463590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.463590] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a60e0c43-f06a-467e-816b-4e256badc10b is going to be created. [ 966.498434] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.498590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.498658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.498917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.499041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.499212] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.499305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.499372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.499652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.499737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.499815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 already deleted. [ 966.500094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.515934] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.516111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.516202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.516412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.516595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.526903] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a60e0c43-f06a-467e-816b-4e256badc10b in Status: IN_PROGRESS for 2s [ 966.615131] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 966.615343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.615550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.615873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.615981] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.757336] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.757336] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.757336] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.757336] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.757925] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.757925] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 707d887d-60f8-4dd4-b3f3-5d5c207cb4fe not found, creating... [ 966.757925] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.758342] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.758342] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.759030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.759030] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.759154] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.759256] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.760459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.760459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.760459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.760459] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 707d887d-60f8-4dd4-b3f3-5d5c207cb4fe is going to be created. [ 966.781713] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.781973] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.782155] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.782479] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.782754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.783022] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.119576] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.119946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.119946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.120040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.120221] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.120329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.120392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.120544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.120637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.120720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.120811] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.623420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.623620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.623715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.624058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.624528] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.624792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.624792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.624992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.625170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.626292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.626292] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.626292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.626292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.626292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.626292] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.626292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.626292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.626643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.626643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.626643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.626643] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.803213] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-f03f5067-af5a-47b6-826c-00ff255cec02 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 967.803406] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-f03f5067-af5a-47b6-826c-00ff255cec02 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 967.803548] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-f03f5067-af5a-47b6-826c-00ff255cec02 service nova] Enqueued Resource ID: 707d887d-60f8-4dd4-b3f3-5d5c207cb4fe with Priority: HIGHEST for action port [ 967.804158] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 967.804158] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 967.804158] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 707d887d-60f8-4dd4-b3f3-5d5c207cb4fe with Priority: HIGHEST for action port [ 967.804719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.804838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.804904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.808351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.808351] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.808351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.808351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.808351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.808351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.808351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.808351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.809351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.809583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.809682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.810766] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.814092] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.814092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.814092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.814092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.814092] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('707d887d-60f8-4dd4-b3f3-5d5c207cb4fe',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.955634] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1adbabf8-04be-44f1-9ae0-0be53d94dd37 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_rules [ 967.956700] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_rules [ 967.956700] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.956700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.956700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.956941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.957012] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.019778] env[70032]: INFO networking_nsxv3.common.synchronization [req-17c44a4e-35a4-4cc9-927e-747dfdd69849 req-77d91779-8f03-4a2f-b517-efcbc5274034 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_members [ 968.019904] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_members [ 968.020247] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d451476b-b529-46a5-ac42-f7b74140c983 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.020375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.021046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.021046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.021046] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.021046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.021046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.021371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.021371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.021472] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.107525] env[70032]: INFO networking_nsxv3.common.synchronization [None req-27ca1fb7-8f6d-4fa9-901c-e798e860dc1b tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_rules [ 968.107943] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_rules [ 968.108272] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.108378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.128671] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d217ae0-b74a-4bed-9ca6-45df455c7a58: rpc.has_security_group_logging(os_id): False [ 968.148646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.148646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.148646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.148646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.148646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.148906] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.148906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.148981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.149139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.149217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.149430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.149527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.149595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.149741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.149819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.149997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.151164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.151241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.151400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.151490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.151644] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 968.216014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.216234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.216315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.216540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.216701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.230556] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 968.317074] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.317284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.317497] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.319274] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 707d887d-60f8-4dd4-b3f3-5d5c207cb4fe with status ACTIVE [ 968.319471] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.319597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.319665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.319873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.319974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.320305] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.320468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.320538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.320673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.320727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.320918] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.320992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.321068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.321234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.321292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.321383] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 707d887d-60f8-4dd4-b3f3-5d5c207cb4fe is going to be updated. [ 968.358543] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.358805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.358896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.359196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.359401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.359663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-707d887d-60f8-4dd4-b3f3-5d5c207cb4fe" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.478629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.478810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.478858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.479380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.479515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.479670] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 already deleted. [ 968.479706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.479846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.480044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.480130] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.524401] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.524690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.524861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.525092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.525253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.525558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.525713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.525822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.526070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.526278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.526421] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d451476b-b529-46a5-ac42-f7b74140c983 already deleted. [ 968.526555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.537335] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a60e0c43-f06a-467e-816b-4e256badc10b in Status: SUCCESS [ 968.537576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.819858] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.999576] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.999742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.999828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.000078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.000174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.000273] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 already deleted. [ 969.000353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.203378] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.203822] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.203822] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.206974] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.207298] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.207482] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.207614] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.207870] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.208039] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.208539] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.208539] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.208539] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.208680] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.208713] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.208819] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.208958] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.210662] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.210828] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.210957] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.211271] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.211534] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.211693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.211813] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.212038] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.212188] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.212375] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.212490] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.212605] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.217022] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.217022] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.217022] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.217022] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.239239] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.239239] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.239239] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.239239] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.239239] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-6ec70463-f243-4b15-95bf-366727322408 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.239239] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.239239] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.239650] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.239856] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ec70463-f243-4b15-95bf-366727322408',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.244225] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.244333] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.244800] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.244800] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.245137] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.245323] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.245412] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.245732] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.245874] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7660aa5-a30b-4a59-957b-bc01fe39ddb6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.322839] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.323115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.323194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.323432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.323528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.323634] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be created. [ 969.349023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.349023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.349023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.349023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.349023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.360268] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: UNINITIALIZED for 2s [ 969.748807] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.749047] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.749166] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.749428] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.749643] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.749855] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port f7660aa5-a30b-4a59-957b-bc01fe39ddb6 not found, creating... [ 969.750198] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.750345] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.750492] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.750754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.750902] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.751228] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.751409] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.751545] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.751792] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.751942] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.752154] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: f7660aa5-a30b-4a59-957b-bc01fe39ddb6 is going to be created. [ 969.753608] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.753739] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.753865] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.754155] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.754243] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.754389] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 6ec70463-f243-4b15-95bf-366727322408 not found, creating... [ 969.754637] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.754836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.754910] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.755206] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.755276] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.755556] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.755715] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.755839] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.756166] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.756325] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.756494] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 6ec70463-f243-4b15-95bf-366727322408 is going to be created. [ 969.778816] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.778978] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.779029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.779283] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.779517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.780045] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.781393] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.781690] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.781864] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.782163] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.782799] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.782799] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.250909] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 970.251272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.688287] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-d8ef33e9-006a-46e3-ac85-6043593ce192 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 970.691022] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-d8ef33e9-006a-46e3-ac85-6043593ce192 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 970.691022] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-d8ef33e9-006a-46e3-ac85-6043593ce192 service nova] Enqueued Resource ID: f7660aa5-a30b-4a59-957b-bc01fe39ddb6 with Priority: HIGHEST for action port [ 970.691022] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 970.691022] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 970.691022] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7660aa5-a30b-4a59-957b-bc01fe39ddb6 with Priority: HIGHEST for action port [ 970.691022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.691022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.691022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.691022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.691022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.691022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.691022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.691022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.691022] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7660aa5-a30b-4a59-957b-bc01fe39ddb6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.707138] env[70032]: INFO networking_nsxv3.common.synchronization [req-17c44a4e-35a4-4cc9-927e-747dfdd69849 req-ed3dc4d5-ab37-408b-98e4-a0fe678211f8 service nova] Enqueued Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_rules [ 970.707495] env[70032]: INFO networking_nsxv3.common.synchronization [req-17c44a4e-35a4-4cc9-927e-747dfdd69849 req-ed3dc4d5-ab37-408b-98e4-a0fe678211f8 service nova] Enqueued Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_members [ 970.707610] env[70032]: INFO networking_nsxv3.common.synchronization [req-17c44a4e-35a4-4cc9-927e-747dfdd69849 req-ed3dc4d5-ab37-408b-98e4-a0fe678211f8 service nova] Enqueued Resource ID: 6ec70463-f243-4b15-95bf-366727322408 with Priority: HIGHEST for action port [ 970.709834] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_rules [ 970.710041] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_members [ 970.710146] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec70463-f243-4b15-95bf-366727322408 with Priority: HIGHEST for action port [ 970.710458] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d451476b-b529-46a5-ac42-f7b74140c983 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.710617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.710697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.710929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.711031] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.712133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d451476b-b529-46a5-ac42-f7b74140c983 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.712222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.712253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.712428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.712897] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.713021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.713178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.713275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.713388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.713495] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.714754] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ec70463-f243-4b15-95bf-366727322408 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.714863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.714941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.715140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.715229] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ec70463-f243-4b15-95bf-366727322408',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.196437] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7660aa5-a30b-4a59-957b-bc01fe39ddb6 with status ACTIVE [ 971.196694] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.196894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.196947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.197519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.197519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.197583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.197728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.197809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.197987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.198083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.198289] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.198389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.198477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.198722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.198851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.198993] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7660aa5-a30b-4a59-957b-bc01fe39ddb6 is going to be updated. [ 971.217010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d451476b-b529-46a5-ac42-f7b74140c983 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.217265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.217530] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.219815] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.219977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.220089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.220237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.220389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.220566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7660aa5-a30b-4a59-957b-bc01fe39ddb6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.220753] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ec70463-f243-4b15-95bf-366727322408 with status ACTIVE [ 971.220917] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.221089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.221089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.221273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.221456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.221549] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.221639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.221639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.221774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.221916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.222227] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.222227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.222227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.222402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.222402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.222468] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ec70463-f243-4b15-95bf-366727322408 is going to be updated. [ 971.242941] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.243148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.243148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.243395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.243530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.243689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ec70463-f243-4b15-95bf-366727322408" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.374024] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.374024] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.374024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.374024] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.376724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.376724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.376724] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.376724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.376724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.376724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.376724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.376724] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.670487] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.670918] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.671203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.671641] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.672110] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.672391] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.672616] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.672982] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.677290] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.677543] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.677729] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.677838] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.677927] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.678084] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.678204] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.678353] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.695955] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.696157] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 971.696317] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.696506] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-526" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.696845] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.697033] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.697160] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.697564] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.697732] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a14fb873-11fb-4eb3-875c-fb2d5879d1c1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.724793] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.876920] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.877148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.878521] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.973328] env[70032]: INFO networking_nsxv3.common.synchronization [req-43f7e3ab-91ba-42f9-88db-2379eaaf04e5 req-ac4851e0-cc0c-4133-aee4-74db2a74f466 tempest-InstanceActionsV221TestJSON-507302934 tempest-InstanceActionsV221TestJSON-507302934-project-member] Enqueued Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_members [ 971.974049] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60e0c43-f06a-467e-816b-4e256badc10b with Priority: HIGHEST for action security_group_members [ 971.974670] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a60e0c43-f06a-467e-816b-4e256badc10b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.975324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.975324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.975324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.975540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.975540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.975729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.975793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.975876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.975979] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a60e0c43-f06a-467e-816b-4e256badc10b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.200814] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.201568] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.201776] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.202101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.202290] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.202466] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a14fb873-11fb-4eb3-875c-fb2d5879d1c1 not found, creating... [ 972.202912] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.203128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.203259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.203495] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.203662] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.203976] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.204228] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.204393] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.204645] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.204808] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.204971] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a14fb873-11fb-4eb3-875c-fb2d5879d1c1 is going to be created. [ 972.225032] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.225032] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.225032] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.225339] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.226191] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.226191] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.226788] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.226914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.226975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.229153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.229153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.229153] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d451476b-b529-46a5-ac42-f7b74140c983 is going to be created. [ 972.258559] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.258755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.258837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.259086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.259183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.271458] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d451476b-b529-46a5-ac42-f7b74140c983 in Status: UNINITIALIZED for 2s [ 972.384305] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.484520] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.484686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.484778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.484973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.485085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.485286] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.485383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.486061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.486061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.486061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.486061] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a60e0c43-f06a-467e-816b-4e256badc10b is going to be updated. [ 972.512592] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.512592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.512592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.512592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.512592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.519818] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a60e0c43-f06a-467e-816b-4e256badc10b in Status: IN_PROGRESS for 2s [ 972.887042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.887257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.887339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.887556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.887652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.887755] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 972.911858] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-7864b372-1af8-4892-b639-74fcaa201baf service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 972.912066] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-7864b372-1af8-4892-b639-74fcaa201baf service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 972.912214] env[70032]: INFO networking_nsxv3.common.synchronization [req-3da7a285-95d9-4633-a2c6-76b3a036c738 req-7864b372-1af8-4892-b639-74fcaa201baf service nova] Enqueued Resource ID: a14fb873-11fb-4eb3-875c-fb2d5879d1c1 with Priority: HIGHEST for action port [ 972.912940] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 972.913167] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 972.913285] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14fb873-11fb-4eb3-875c-fb2d5879d1c1 with Priority: HIGHEST for action port [ 972.914553] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.914665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.914739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.914942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.915099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.916292] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.916389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.916585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.916682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.916841] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.916938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.916998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.917218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.917276] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a14fb873-11fb-4eb3-875c-fb2d5879d1c1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.929021] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 973.420702] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a14fb873-11fb-4eb3-875c-fb2d5879d1c1 with status ACTIVE [ 973.420702] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.420702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.421148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.421148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.421148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.421234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.421319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.421381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.421535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.421612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.421812] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.421876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.421967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.422178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.422178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.422249] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a14fb873-11fb-4eb3-875c-fb2d5879d1c1 is going to be updated. [ 973.442882] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.443056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.443138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.443736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.443736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.443736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a14fb873-11fb-4eb3-875c-fb2d5879d1c1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.284083] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d451476b-b529-46a5-ac42-f7b74140c983 in Status: SUCCESS [ 974.284083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.284083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.284083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.284083] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.284083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.284083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.284083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.285996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.285996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.285996] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.530750] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a60e0c43-f06a-467e-816b-4e256badc10b in Status: SUCCESS [ 974.531179] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a60e0c43-f06a-467e-816b-4e256badc10b deletion is rescheduled due to dependency. [ 974.531179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a60e0c43-f06a-467e-816b-4e256badc10b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.787425] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.938441] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 974.938710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.938924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.939210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.939389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.939509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.939578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.939737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.939839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.939928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.940108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.940194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.940263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.940472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.940730] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.940860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.940939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.941262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.941336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941471] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.942414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.942882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.942882] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.942991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.942991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.943152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.943258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.943356] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.291797] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d451476b-b529-46a5-ac42-f7b74140c983: rpc.has_security_group_logging(os_id): False [ 975.314963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.314963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.314963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.314963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.314963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.315277] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.315277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.315367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.315514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.317612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.318897] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d451476b-b529-46a5-ac42-f7b74140c983 is going to be created. [ 975.394271] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.394480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.394480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.394702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.394963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.406995] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d451476b-b529-46a5-ac42-f7b74140c983 in Status: IN_PROGRESS for 2s [ 975.446069] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26164ff-f3d0-4ac4-97ed-86984dd723e3: rpc.has_security_group_logging(os_id): False [ 975.447557] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.467034] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.467350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.467666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.467946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.468087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.468459] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.468595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.468769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.468939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.469055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.469380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.469957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.469957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.469957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.469957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.470255] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.470386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.470433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.470582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.470748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.470829] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be created. [ 975.538908] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.539277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.539277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.539447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.539598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.555255] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 975.760679] env[70032]: INFO networking_nsxv3.common.synchronization [req-94c74dec-ae16-4095-a486-84b025306f07 req-0868d7c2-6cf6-4b07-8f3e-01ccd4a276f2 tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 975.761248] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 975.761878] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.761878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.761878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.762121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.762121] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.762329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.762329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.762431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.762431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.762523] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.950817] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.230603] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.230819] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.230947] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.231233] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.231498] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.231656] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.231777] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.231990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.232156] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.232376] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.232494] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.232605] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.232757] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.232955] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.233137] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.233285] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.264515] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.264708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.264785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.264963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.265072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.265313] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.265395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.265446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.265634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.265634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.265723] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 already deleted. [ 976.265800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.266950] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.267137] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.267277] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.267440] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.267723] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-5b806c80-b932-478e-88be-0d1358926ca4 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.267902] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.268033] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.268285] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.268426] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b806c80-b932-478e-88be-0d1358926ca4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.457583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.457749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.457822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.458060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.458157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.458275] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 976.488920] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.489099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.489865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.489865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.489865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.498864] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 976.770374] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.770650] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.771636] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.771636] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.771636] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.771636] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 5b806c80-b932-478e-88be-0d1358926ca4 not found, creating... [ 976.771810] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.771868] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.771939] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.772185] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.772326] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.772609] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.772760] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.772877] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.773580] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.773750] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.773900] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 5b806c80-b932-478e-88be-0d1358926ca4 is going to be created. [ 976.794627] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.794877] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.795015] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.795319] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.795564] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.795847] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.418563] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d451476b-b529-46a5-ac42-f7b74140c983 in Status: SUCCESS [ 977.418908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.566491] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 977.566731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.566933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.567216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.567299] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.618112] env[70032]: INFO networking_nsxv3.common.synchronization [req-94c74dec-ae16-4095-a486-84b025306f07 req-8d8a29e7-ef72-405c-9e7b-d59b49c20fdd service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 977.618112] env[70032]: INFO networking_nsxv3.common.synchronization [req-94c74dec-ae16-4095-a486-84b025306f07 req-8d8a29e7-ef72-405c-9e7b-d59b49c20fdd service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 977.618112] env[70032]: INFO networking_nsxv3.common.synchronization [req-94c74dec-ae16-4095-a486-84b025306f07 req-8d8a29e7-ef72-405c-9e7b-d59b49c20fdd service nova] Enqueued Resource ID: 5b806c80-b932-478e-88be-0d1358926ca4 with Priority: HIGHEST for action port [ 977.618690] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 977.618820] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 977.618928] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b806c80-b932-478e-88be-0d1358926ca4 with Priority: HIGHEST for action port [ 977.622034] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.622034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.622034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.622034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.622034] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.623181] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.623314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.623400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.623614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.623832] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.624010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.624056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.624252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.624343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.624469] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.625456] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b806c80-b932-478e-88be-0d1358926ca4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.625580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.625697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.625884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.625965] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b806c80-b932-478e-88be-0d1358926ca4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.072953] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.073228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.131095] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.131095] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.131095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.131095] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b806c80-b932-478e-88be-0d1358926ca4 with status ACTIVE [ 978.131095] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.131095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.131095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.131449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.131449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.131449] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.131543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.131580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.131744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.131796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.131971] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.132114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.132184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.132272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.132340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.132420] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b806c80-b932-478e-88be-0d1358926ca4 is going to be updated. [ 978.151591] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.151733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.151846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.151990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.152843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.152843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b806c80-b932-478e-88be-0d1358926ca4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.509759] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 978.510011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.510240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.510767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.510767] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.510962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.510962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.511031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.511191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.511191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.511290] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.634676] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.017027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.017027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.017027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.017027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.017027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.017613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.017613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.017613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.017613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.017613] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.138014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.138685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.138865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.139167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.139344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.140054] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 979.156161] env[70032]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'data': {'id': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'display_name': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'path': '/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'expression': [{'value': 'security_group|1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['192.168.128.3']}], 'tags': [{'scope': 'age', 'tag': 1743815993}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500127,\n "module_name" : "Policy",\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\n}' [ 979.157468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.157468] env[70032]: Traceback (most recent call last): [ 979.157468] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 979.157468] env[70032]: listener.cb(fileno) [ 979.157468] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 979.157468] env[70032]: result = function(*args, **kwargs) [ 979.157468] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 178, in security_group_members [ 979.157468] env[70032]: self.nsx_provider.sg_members_realize( [ 979.157468] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1030, in sg_members_realize [ 979.157468] env[70032]: return self._realize(Provider.SG_MEMBERS, delete, self.payload.sg_members_container, os_sg, provider_group) [ 979.157468] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 979.157468] env[70032]: return func(*args, **kwargs) [ 979.157468] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 785, in _realize [ 979.157468] env[70032]: res = self.client.put(path=path, data=data) [ 979.157468] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 125, in decorator [ 979.157468] env[70032]: raise RuntimeError(msg, last_err) [ 979.157468] env[70032]: RuntimeError: (None, 'Error Code=400 Message=b\'{\\n "httpStatus" : "BAD_REQUEST",\\n "error_code" : 500127,\\n "module_name" : "Policy",\\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\\n}\'') [ 979.157468] env[70032]: Removing descriptor: 64 [ 979.157468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.158014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.158014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.158092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.158128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.158434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.158434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.158529] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.520433] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26164ff-f3d0-4ac4-97ed-86984dd723e3: rpc.has_security_group_logging(os_id): False [ 979.537884] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.538143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.538224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.538466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.538586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.538854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.539024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.539125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.539342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.539482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.539849] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.539908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.539956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.540112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.540210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.540541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.540541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.540649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.540856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.540958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.541064] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 979.599113] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.599303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.599420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.599713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.599805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.612420] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 979.662482] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.166202] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.669583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.669887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.670050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.670310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.670441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.670574] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 980.689330] env[70032]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'data': {'id': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'display_name': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'path': '/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'expression': [{'value': 'security_group|1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['192.168.128.3']}], 'tags': [{'scope': 'age', 'tag': 1743815994}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500127,\n "module_name" : "Policy",\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\n}' [ 980.689613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.689681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.690045] env[70032]: Traceback (most recent call last): [ 980.690045] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 980.690045] env[70032]: listener.cb(fileno) [ 980.690045] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 980.690045] env[70032]: result = function(*args, **kwargs) [ 980.690045] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 194, in security_group_rules [ 980.690045] env[70032]: self.security_group_members(os_id, reference=True) [ 980.690045] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 178, in security_group_members [ 980.690045] env[70032]: self.nsx_provider.sg_members_realize( [ 980.690045] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1030, in sg_members_realize [ 980.690045] env[70032]: return self._realize(Provider.SG_MEMBERS, delete, self.payload.sg_members_container, os_sg, provider_group) [ 980.690045] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 980.690045] env[70032]: return func(*args, **kwargs) [ 980.690045] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 785, in _realize [ 980.690045] env[70032]: res = self.client.put(path=path, data=data) [ 980.690045] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 125, in decorator [ 980.690045] env[70032]: raise RuntimeError(msg, last_err) [ 980.690045] env[70032]: RuntimeError: (None, 'Error Code=400 Message=b\'{\\n "httpStatus" : "BAD_REQUEST",\\n "error_code" : 500127,\\n "module_name" : "Policy",\\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\\n}\'') [ 980.690045] env[70032]: Removing descriptor: 64 [ 980.754136] env[70032]: INFO networking_nsxv3.common.synchronization [req-1c66c184-a8c8-484b-9f5c-b3d84ccc17a3 req-e7fb6551-3dc9-4c95-8377-40f761b927d7 tempest-ListServerFiltersTestJSON-951974945 tempest-ListServerFiltersTestJSON-951974945-project-member] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 980.754681] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 980.754911] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.755047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.755110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.755310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.755510] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.755592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.755626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.755767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.755815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.755906] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.259422] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.625356] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 981.625622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.625851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.626140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.626384] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.763402] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.129995] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.130398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.130398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.130722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.130800] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.130991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.131040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.131180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.131322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.131418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.131508] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.265635] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.265997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.265997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.266124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.266183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.266346] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 982.293284] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.293498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.293552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.293732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.293877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.302266] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 982.634315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.634501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.634603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.634847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.634989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.635103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.635167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.635341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.635433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.635556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.635823] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.635907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.635907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.636223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.636297] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.636418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.636465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.636647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.636727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.636824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.636963] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.139177] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26164ff-f3d0-4ac4-97ed-86984dd723e3: rpc.has_security_group_logging(os_id): False [ 983.156279] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.156279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.156279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.156493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.156600] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.156784] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.156879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.156934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.157126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.157209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.157449] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.157547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.157598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.157741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.157817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.158701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.158870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.158958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.159132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.159217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.159320] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 983.231161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.231381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.231381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.231585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.231729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.249207] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 984.312430] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 984.312821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.266353] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 985.266660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.755679] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 985.755968] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 985.811368] env[70032]: INFO networking_nsxv3.common.synchronization [req-7051171a-09be-439e-a403-2fb361bdab28 req-a47ed7a2-d2f2-489e-ad7b-9ef83b59aeef tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 985.811368] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 985.811368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.811368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.811368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.811368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.811368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.811368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.811368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.811368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.811368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.811368] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.021743] env[70032]: INFO networking_nsxv3.common.synchronization [req-7051171a-09be-439e-a403-2fb361bdab28 req-15c2b1cd-f470-4d07-a795-337af66494e4 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 986.022325] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 986.023583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.023583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.278211] env[70032]: INFO networking_nsxv3.common.synchronization [req-7051171a-09be-439e-a403-2fb361bdab28 req-05602f78-9781-4ca1-b2f4-508149440ef2 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 986.278211] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 986.278211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.278211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.313544] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.820065] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.321469] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.321665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.321724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.321918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.322024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.322131] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 987.349819] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.349819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.349819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.349819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.349819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.357201] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 989.368679] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 989.369068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.369115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.369341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.369534] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.369654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.369732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.369922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.369976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.370091] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.872578] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.872744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.872792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.873026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.873135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.873568] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.873568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.873568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.873745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.873745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.873815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 989.901756] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.902090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.902231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.902455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.902593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.913276] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 990.158062] env[70032]: INFO networking_nsxv3.common.synchronization [req-ca7ee372-8b07-47de-b162-4cac0f3478bb req-33fa775d-692f-466f-91e0-1e0d02b88663 tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 990.158459] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 990.158779] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.158950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.162104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.162355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.162580] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.162692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.162755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.162931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.163023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.164874] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.596729] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.597667] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.597667] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.597667] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.597791] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.597967] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.598019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.598280] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.598441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.598677] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.598801] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.598920] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.599073] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.599198] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.599311] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.599454] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.620028] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.620028] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.620028] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.620028] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.620299] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-48068beb-d371-43d7-946d-c66d5a1883fc taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.620557] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.620647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.621037] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.621195] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48068beb-d371-43d7-946d-c66d5a1883fc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.666690] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.124923] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.125147] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.125147] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.125882] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.125882] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.125882] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 48068beb-d371-43d7-946d-c66d5a1883fc not found, creating... [ 991.126073] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.126527] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.126527] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.126527] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.126675] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.126992] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.127517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.127517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.127517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.127648] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.128277] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 48068beb-d371-43d7-946d-c66d5a1883fc is going to be created. [ 991.147647] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.148043] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.148255] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.148652] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.149055] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.149403] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.169787] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.672761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.673151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.673151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.673336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.673451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.673558] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 991.703011] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.703201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.703240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.703443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.703590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.713258] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 991.849306] env[70032]: INFO networking_nsxv3.common.synchronization [req-ca7ee372-8b07-47de-b162-4cac0f3478bb req-0cc6cef8-185a-4b68-ab18-48eb345f794d service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 991.849306] env[70032]: INFO networking_nsxv3.common.synchronization [req-ca7ee372-8b07-47de-b162-4cac0f3478bb req-0cc6cef8-185a-4b68-ab18-48eb345f794d service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 991.849306] env[70032]: INFO networking_nsxv3.common.synchronization [req-ca7ee372-8b07-47de-b162-4cac0f3478bb req-0cc6cef8-185a-4b68-ab18-48eb345f794d service nova] Enqueued Resource ID: 48068beb-d371-43d7-946d-c66d5a1883fc with Priority: HIGHEST for action port [ 991.849306] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 991.849306] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 991.849306] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48068beb-d371-43d7-946d-c66d5a1883fc with Priority: HIGHEST for action port [ 991.849306] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.849306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.849306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.849306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.849306] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.850879] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.851110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.851409] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-48068beb-d371-43d7-946d-c66d5a1883fc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.851633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.851789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.852048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.852228] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48068beb-d371-43d7-946d-c66d5a1883fc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.924846] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 991.924846] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 deletion is rescheduled due to dependency. [ 991.924846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.924846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.924846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.924846] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.924846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.924846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.924846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.924846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.924846] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.354566] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.354760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.356052] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48068beb-d371-43d7-946d-c66d5a1883fc with status ACTIVE [ 992.356242] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.356444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.356517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.356736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.356825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.356997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.357104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.357167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.357379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.357475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.357665] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.357764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.357816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.357973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.358047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.358150] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48068beb-d371-43d7-946d-c66d5a1883fc is going to be updated. [ 992.382413] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.382413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.382413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.382413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.382413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.382413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48068beb-d371-43d7-946d-c66d5a1883fc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.426781] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.427115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.427115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.427278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.427369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.427578] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.427680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.427747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.427894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.427971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.428078] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 992.454989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.455200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.455268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.455489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.455636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.464376] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 992.862447] env[70032]: INFO networking_nsxv3.common.synchronization [req-6bc20063-c22f-405d-8895-e76cc80a9a60 req-4c071695-b441-4582-933d-8b1685ab8d12 tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 992.864065] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 992.866746] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.866746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.866746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.866746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.866746] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.866746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.866746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.866746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.866746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.866746] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.185119] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.185305] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.185451] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.185769] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.186125] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.186355] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.186582] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.186864] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.187111] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.187429] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.187867] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.187867] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.187867] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.188014] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.188169] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.188349] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.215357] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.215357] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.215357] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.215357] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.215357] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-aa814895-eb72-4654-98da-36f81663b83a taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.215357] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.215357] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.215896] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.216295] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa814895-eb72-4654-98da-36f81663b83a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.369723] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.370018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.370157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.370414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.370517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.370786] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.370947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.371056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.371265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.371355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.371453] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 already deleted. [ 993.371530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.719151] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.719375] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.719523] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.719807] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.719962] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.720143] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port aa814895-eb72-4654-98da-36f81663b83a not found, creating... [ 993.720590] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.720590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.720739] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.720969] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.722313] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.722634] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.722821] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.722951] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.723203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.723351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.723502] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: aa814895-eb72-4654-98da-36f81663b83a is going to be created. [ 993.731912] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 993.732146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.732312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.732526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.732710] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.732814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.732874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.733037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.733123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.733220] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.740251] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.740481] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.740613] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.740857] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.741117] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.741368] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.235957] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.458038] env[70032]: INFO networking_nsxv3.common.synchronization [req-6bc20063-c22f-405d-8895-e76cc80a9a60 req-86c749b7-6b35-4f5b-a16c-ef4fe90eb0de service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 994.458038] env[70032]: INFO networking_nsxv3.common.synchronization [req-6bc20063-c22f-405d-8895-e76cc80a9a60 req-86c749b7-6b35-4f5b-a16c-ef4fe90eb0de service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 994.458038] env[70032]: INFO networking_nsxv3.common.synchronization [req-6bc20063-c22f-405d-8895-e76cc80a9a60 req-86c749b7-6b35-4f5b-a16c-ef4fe90eb0de service nova] Enqueued Resource ID: aa814895-eb72-4654-98da-36f81663b83a with Priority: HIGHEST for action port [ 994.458038] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 994.458038] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 994.458659] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa814895-eb72-4654-98da-36f81663b83a with Priority: HIGHEST for action port [ 994.459333] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.459688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.459846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.460151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.460323] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.461481] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.462908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.462908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.462908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.462908] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.462908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.462908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.462908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.462908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.462908] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.465249] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa814895-eb72-4654-98da-36f81663b83a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.466047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.466134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.466263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.466506] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa814895-eb72-4654-98da-36f81663b83a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.479027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 994.479027] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 deletion is rescheduled due to dependency. [ 994.479027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.739069] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.966348] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.968933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.968933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.969079] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa814895-eb72-4654-98da-36f81663b83a with status ACTIVE [ 994.969198] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.969312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.969380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.969634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.969759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.969941] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.970089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.970146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.970818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.970818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.970818] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.970818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.970818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.970818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.972080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.972080] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa814895-eb72-4654-98da-36f81663b83a is going to be updated. [ 994.996770] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.997029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.997082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.997398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.997576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.997856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa814895-eb72-4654-98da-36f81663b83a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.243406] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.243406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.243406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.243406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.243406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.243406] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 995.280416] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.280608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.280694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.280932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.281164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.290674] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 995.446149] env[70032]: INFO networking_nsxv3.common.synchronization [req-43570e69-457f-4d5f-8343-6c32509c4242 req-b9bf1362-3781-4a7c-844e-c353637556b8 tempest-ServerRescueTestJSON-709973283 tempest-ServerRescueTestJSON-709973283-project-member] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 995.446732] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 995.447148] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.447294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.447368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.447674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.447881] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.448165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.448165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.448425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.448425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.448525] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.473472] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.832676] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.832950] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.833031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.833380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.833684] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.833855] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.833979] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.834918] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.834918] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.835040] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.836215] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.836215] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.836511] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.836511] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.836609] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.836743] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.856954] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.857157] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.857302] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.857497] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.857830] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-1bbab045-a081-434e-b110-97af431eade4 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.858016] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.858145] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.858475] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.858625] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bbab045-a081-434e-b110-97af431eade4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.951129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.951314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.951397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.951649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.951721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.951922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.952465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.952541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.952701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.952781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.952887] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f37877-f530-4fa7-afd7-080093e64471 already deleted. [ 995.952969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.974714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.974884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.974975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.975776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.975776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.975776] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be created. [ 996.000717] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.000799] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.000838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.001075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.001644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.009746] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: UNINITIALIZED for 2s [ 996.361998] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.362429] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.362429] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.362643] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.362810] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.363066] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 1bbab045-a081-434e-b110-97af431eade4 not found, creating... [ 996.363262] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.363432] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.363532] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.363793] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.364121] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.364276] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.364427] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.364541] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.364753] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.364895] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.365925] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 1bbab045-a081-434e-b110-97af431eade4 is going to be created. [ 996.390612] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.390835] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.390956] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.391270] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.391591] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.391723] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.183517] env[70032]: INFO networking_nsxv3.common.synchronization [req-43570e69-457f-4d5f-8343-6c32509c4242 req-50444218-1eb7-4dd7-91b6-44ce09e73cdb service nova] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_rules [ 997.183580] env[70032]: INFO networking_nsxv3.common.synchronization [req-43570e69-457f-4d5f-8343-6c32509c4242 req-50444218-1eb7-4dd7-91b6-44ce09e73cdb service nova] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 997.183722] env[70032]: INFO networking_nsxv3.common.synchronization [req-43570e69-457f-4d5f-8343-6c32509c4242 req-50444218-1eb7-4dd7-91b6-44ce09e73cdb service nova] Enqueued Resource ID: 1bbab045-a081-434e-b110-97af431eade4 with Priority: HIGHEST for action port [ 997.183943] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_rules [ 997.184076] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 997.184171] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbab045-a081-434e-b110-97af431eade4 with Priority: HIGHEST for action port [ 997.184746] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.184869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.184937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.185327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.185454] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.186392] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.186813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.186813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.186813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.186993] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.187131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.187257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.187438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.187557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.187669] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.188480] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bbab045-a081-434e-b110-97af431eade4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.188622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.188714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.188892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.188998] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bbab045-a081-434e-b110-97af431eade4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.302371] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 997.302371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.302371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.302371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.302818] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.302985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.303156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.303433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.303612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.303799] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.304048] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.691465] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.692115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.692226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.693802] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bbab045-a081-434e-b110-97af431eade4 with status ACTIVE [ 997.693895] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.693951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.694032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.694252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.694356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.694491] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.694854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.694854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.694854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.694986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.695081] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.695175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.695234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.695373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.695448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.695612] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bbab045-a081-434e-b110-97af431eade4 is going to be updated. [ 997.698109] env[70032]: INFO networking_nsxv3.common.synchronization [req-b27f345a-801f-4575-a86c-9d208faa0a47 req-447921f5-d3f9-4df5-ab83-11f323f91734 tempest-MigrationsAdminTest-411767673 tempest-MigrationsAdminTest-411767673-project-member] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 997.698723] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 997.699244] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.699344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.699472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.699563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.699733] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.700034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.700034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.700034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.700148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.700178] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.716502] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.716654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.716715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.716897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.717059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.717190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bbab045-a081-434e-b110-97af431eade4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.806753] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.806907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.806964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.807196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.807376] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.807490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.807556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.807712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.807803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.807891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.808051] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.808146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.808206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.808350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.808507] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.808605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.808661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.808813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.808890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.808970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.809069] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.019015] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 998.019253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.019433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.019668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.019859] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.019992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.020070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.020235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.020318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.020402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.020547] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.138135] env[70032]: INFO networking_nsxv3.common.synchronization [req-23c06e84-83e3-4c9c-baec-335ae39d4e6b req-9e791c4d-0694-401b-8c41-2cce2c70d9a0 tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 998.139132] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 998.139469] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.139651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.139718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.139932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.140532] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.140734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.140810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.141081] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.141183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.141281] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.193535] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.202406] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.312014] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 750167f1-a8ae-4a8e-a9a0-cd5ce2550684: rpc.has_security_group_logging(os_id): False [ 998.330011] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.330212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.330281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.330481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.330577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.330830] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.330934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.331016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.331165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.331246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.331685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.331808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.331868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.332092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.332178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.332464] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.332464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.332565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.332698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.332777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.332859] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 998.401476] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.401695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.401695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.401967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.402128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.413313] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 998.524926] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.614489] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.614692] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.614823] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.615121] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.615433] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.615602] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.615726] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.615990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.616118] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.616394] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.616500] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.616594] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.616717] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.616848] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.616967] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.617144] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.638155] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.638324] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.638461] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.638635] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.639106] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-9e97c68b-b962-4b29-9aad-5d9f8bab8920 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.639265] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.639265] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.639588] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.640184] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e97c68b-b962-4b29-9aad-5d9f8bab8920',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.644788] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.644913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.644986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.645186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.645276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.645457] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.645555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.645615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.645766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.645842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.645928] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be deleted. [ 998.678948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.679112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.679185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.679391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.679483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.679582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.696044] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.696298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.696298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.696503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.696591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.696691] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be created. [ 998.704424] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.718033] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.718033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.718033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.718209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.718319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.727918] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: UNINITIALIZED for 2s [ 999.029138] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d6919e6-e32b-4e99-b10c-70b263dc0104: rpc.has_security_group_logging(os_id): False [ 999.048615] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.048778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.048843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.049081] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.049186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.049455] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.049690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.049690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.049840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.049992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.049992] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be created. [ 999.111043] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.111043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.111043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.111043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.111043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.120742] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 999.142428] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.142748] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.142923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.143335] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.143624] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.143832] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 9e97c68b-b962-4b29-9aad-5d9f8bab8920 not found, creating... [ 999.144147] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.144403] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.144559] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.144990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.145126] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.145437] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.145630] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.145818] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.146115] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.146288] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.146542] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 9e97c68b-b962-4b29-9aad-5d9f8bab8920 is going to be created. [ 999.171872] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.171950] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.172099] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.172346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.172628] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.172858] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.206822] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.207010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.207090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.207306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.207408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.207504] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be updated. [ 999.285907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.286083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.286124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.286366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.286507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.311331] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: IN_PROGRESS for 2s [ 999.945863] env[70032]: INFO networking_nsxv3.common.synchronization [req-23c06e84-83e3-4c9c-baec-335ae39d4e6b req-b6216c1b-8684-48d2-b377-ba64607bdf31 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 999.945863] env[70032]: INFO networking_nsxv3.common.synchronization [req-23c06e84-83e3-4c9c-baec-335ae39d4e6b req-b6216c1b-8684-48d2-b377-ba64607bdf31 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 999.945863] env[70032]: INFO networking_nsxv3.common.synchronization [req-23c06e84-83e3-4c9c-baec-335ae39d4e6b req-b6216c1b-8684-48d2-b377-ba64607bdf31 service nova] Enqueued Resource ID: 9e97c68b-b962-4b29-9aad-5d9f8bab8920 with Priority: HIGHEST for action port [ 999.946589] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 999.946589] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 999.946589] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e97c68b-b962-4b29-9aad-5d9f8bab8920 with Priority: HIGHEST for action port [ 999.946811] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.947269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.947269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.947359] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.947518] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.949849] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.950211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.950211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.950328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.950602] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.950750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.950834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.951016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.951143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.951256] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.952104] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e97c68b-b962-4b29-9aad-5d9f8bab8920 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.952252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.952341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.952530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.952630] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e97c68b-b962-4b29-9aad-5d9f8bab8920',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.432341] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1000.432723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.454463] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.454601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.454805] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.456211] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e97c68b-b962-4b29-9aad-5d9f8bab8920 with status ACTIVE [ 1000.456211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.456211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.456211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.456452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.456491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.457078] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.457078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.457078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.457271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.457271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.457476] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.457641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.457760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.457920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.457999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.458106] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e97c68b-b962-4b29-9aad-5d9f8bab8920 is going to be updated. [ 1000.478911] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.479058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.479139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.479323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.479450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.479606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e97c68b-b962-4b29-9aad-5d9f8bab8920" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.740027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: SUCCESS [ 1000.740237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.740418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.740626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.741158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.741158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.741158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.741393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.741393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.741393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.741532] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.805115] env[70032]: INFO networking_nsxv3.common.synchronization [req-9eecd171-1980-480d-b1bf-84b6c7d776c9 req-52ec5194-180f-400d-bee7-63c53349ff6d tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1000.805627] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1000.805923] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.806546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.806761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.806900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.807097] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.807227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.807319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.807524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.807701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.807759] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.959877] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.131673] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1001.131902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.243687] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.243687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.243687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.243915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.244027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.244147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.244205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.244372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.244455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.244542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.244685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.244771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.244828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.244965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.245108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.245194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.245248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.245379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.245447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.245523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.245610] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.310212] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.310212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.310386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.310538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.310608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.311011] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.311152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.311283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.311346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.311431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.311532] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 already deleted. [ 1001.311724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.319925] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 1001.320136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.463027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.463170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.463253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.463556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.463556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.463622] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be created. [ 1001.484323] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.484501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.484576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.484789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.485409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.493392] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: UNINITIALIZED for 2s [ 1001.747520] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f37877-f530-4fa7-afd7-080093e64471: rpc.has_security_group_logging(os_id): False [ 1001.764950] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.765205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.765205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.765392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.765485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.765680] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.765779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.765846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.765989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.766085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.766420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.766420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.766567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.766655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.766705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.766884] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.766975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.767551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.767551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.767551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.767551] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be created. [ 1001.820851] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.821059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.821124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.821293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.821475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.835141] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: IN_PROGRESS for 2s [ 1002.080401] env[70032]: INFO networking_nsxv3.common.synchronization [req-6420eb4a-a3f9-4dfc-a35d-601a0f4cecbf req-df875ab2-26a7-4bb3-b2b8-eaf44197ac76 tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 1002.083236] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 1002.083864] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.084447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.084600] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.085125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.085125] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.085318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.085485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.085830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.086840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.086840] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.592573] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.592573] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.592573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.592573] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be deleted. [ 1002.616274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.617863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.617947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.619080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.619182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.619298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.724588] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.724797] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.724943] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.725322] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.725634] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.725807] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.725931] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.727580] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.728810] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.729053] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.729186] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.729304] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.729420] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.729538] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.729649] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.729791] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.749292] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.749488] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.749819] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.749819] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-538" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.750163] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-56c8c730-0496-4b45-88a3-bac5053cbb6f taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.750343] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.750494] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.750825] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.750972] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c8c730-0496-4b45-88a3-bac5053cbb6f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.262509] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.262509] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 56c8c730-0496-4b45-88a3-bac5053cbb6f not found, creating... [ 1003.262509] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.262509] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.263130] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.263130] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.263130] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.263629] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.263961] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.265112] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 56c8c730-0496-4b45-88a3-bac5053cbb6f is going to be created. [ 1003.286019] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.286019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.286019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.286019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.286019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.286019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.504694] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1003.505490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.507018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.507018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.507018] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.507018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.507018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.507535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.507796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.508091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.508447] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.851082] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: SUCCESS [ 1003.851403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.015169] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.015331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.015404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.015620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.015790] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.015891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.015957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.016119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.016207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.016293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.016469] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.016562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.016624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.016767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.016904] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.017025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.017098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.017245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.017321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.017403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.017496] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.084987] env[70032]: INFO networking_nsxv3.common.synchronization [req-6420eb4a-a3f9-4dfc-a35d-601a0f4cecbf req-b4d0d5bb-1f73-4925-800d-5cb22305dfae service nova] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_rules [ 1004.085205] env[70032]: INFO networking_nsxv3.common.synchronization [req-6420eb4a-a3f9-4dfc-a35d-601a0f4cecbf req-b4d0d5bb-1f73-4925-800d-5cb22305dfae service nova] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 1004.085347] env[70032]: INFO networking_nsxv3.common.synchronization [req-6420eb4a-a3f9-4dfc-a35d-601a0f4cecbf req-b4d0d5bb-1f73-4925-800d-5cb22305dfae service nova] Enqueued Resource ID: 56c8c730-0496-4b45-88a3-bac5053cbb6f with Priority: HIGHEST for action port [ 1004.085587] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_rules [ 1004.085816] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 1004.085816] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c8c730-0496-4b45-88a3-bac5053cbb6f with Priority: HIGHEST for action port [ 1004.086367] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.086532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.086605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.086800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.086920] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.088140] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.088140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.088299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.088421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.088606] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.090706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.090706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.090706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.090852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.090852] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.091630] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-56c8c730-0496-4b45-88a3-bac5053cbb6f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.091738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.091846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.091940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.092020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c8c730-0496-4b45-88a3-bac5053cbb6f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.522302] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac44685-7555-444d-b1ce-19ece671a825: rpc.has_security_group_logging(os_id): False [ 1004.541145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.541145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.541145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.541145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.541708] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.541708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.541708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.541708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.541708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.541708] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be created. [ 1004.594333] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.594526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.594591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.594792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.594970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.596118] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.596264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.596445] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.597632] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56c8c730-0496-4b45-88a3-bac5053cbb6f with status ACTIVE [ 1004.597738] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.597965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.597965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.598097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.598161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.598402] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.598559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.598559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.598636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.598762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.598958] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.599098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.599144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.599267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.599345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.599416] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56c8c730-0496-4b45-88a3-bac5053cbb6f is going to be updated. [ 1004.616689] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1004.625065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.625220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.625291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.625484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.625619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.625771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56c8c730-0496-4b45-88a3-bac5053cbb6f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.101510] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.604332] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.604624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.604624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.604797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.604882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.604999] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be created. [ 1005.627402] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.627530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.627625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.627830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.627990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.636585] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: UNINITIALIZED for 2s [ 1006.144268] env[70032]: INFO networking_nsxv3.common.synchronization [req-c8e513dd-af6a-4bfe-83f2-8e6db2060a24 req-9ebd1b97-a024-46da-82ec-3a25d665d9fa tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1006.144822] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1006.145548] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.145703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.145778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.146038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.146216] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.146321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.146436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.146654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.146746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.146847] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.474414] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.474414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.474414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.474414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.474414] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.474414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.474414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.474414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.474414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.474414] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.474929] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.474929] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.474929] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.475036] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.475144] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.475315] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.493634] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.493816] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.493964] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.494170] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.494511] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-deccb840-6166-4f4f-b692-e0c02eedea51 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.494698] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.494826] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.495177] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.495323] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deccb840-6166-4f4f-b692-e0c02eedea51',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.629373] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1006.629667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.649608] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.997975] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.998253] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.998388] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.998797] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.999020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.999227] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port deccb840-6166-4f4f-b692-e0c02eedea51 not found, creating... [ 1006.999505] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.999673] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.999796] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.000049] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.000212] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.000495] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.000656] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.000778] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.000993] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.001167] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.001361] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: deccb840-6166-4f4f-b692-e0c02eedea51 is going to be created. [ 1007.023917] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.024131] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.024268] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.025029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.025029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.025029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.154769] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.219065] env[70032]: INFO networking_nsxv3.common.synchronization [req-15cba40d-d1d9-4f42-8915-979d3699c73b req-335af0f0-cd3f-408b-a72a-81dd7064cb1e tempest-ListImageFiltersTestJSON-2030612318 tempest-ListImageFiltersTestJSON-2030612318-project-member] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 1007.219557] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 1007.219859] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.219974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.220183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.220406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.220566] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.220668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.220732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.220882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.220973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.221084] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.645696] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 1007.646019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.646179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.646487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.646724] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.646865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.646964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.647159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.647274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.647368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.647478] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.657317] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.657447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.657534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.657693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.657776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.657887] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1007.704618] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.704618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.704618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.704618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.704618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.710054] env[70032]: INFO networking_nsxv3.common.synchronization [req-c8e513dd-af6a-4bfe-83f2-8e6db2060a24 req-703bb714-f44f-40b7-bd76-210b58a020fa service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 1007.711089] env[70032]: INFO networking_nsxv3.common.synchronization [req-c8e513dd-af6a-4bfe-83f2-8e6db2060a24 req-703bb714-f44f-40b7-bd76-210b58a020fa service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1007.711089] env[70032]: INFO networking_nsxv3.common.synchronization [req-c8e513dd-af6a-4bfe-83f2-8e6db2060a24 req-703bb714-f44f-40b7-bd76-210b58a020fa service nova] Enqueued Resource ID: deccb840-6166-4f4f-b692-e0c02eedea51 with Priority: HIGHEST for action port [ 1007.711089] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 1007.711089] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1007.711796] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deccb840-6166-4f4f-b692-e0c02eedea51 with Priority: HIGHEST for action port [ 1007.713116] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1007.713495] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.713869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.714487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.714487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.714487] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.715952] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.716196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.716450] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-deccb840-6166-4f4f-b692-e0c02eedea51 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.716597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.716689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.716881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.716989] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deccb840-6166-4f4f-b692-e0c02eedea51',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.722944] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.150707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.150707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.150707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.150977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.151053] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.151168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.151244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.151417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.151537] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.151642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.151801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.151908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.151970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.152142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.152291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.152382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.152442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.152579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.152670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.152753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.152840] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.216994] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.217148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.219493] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port deccb840-6166-4f4f-b692-e0c02eedea51 with status ACTIVE [ 1008.219690] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.219807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.219877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.220103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.220195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.220375] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.220474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.220533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.220686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.220762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.220940] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.221040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.221107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.221237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.221297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.221384] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: deccb840-6166-4f4f-b692-e0c02eedea51 is going to be updated. [ 1008.225098] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.260647] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.260847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.260847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.261061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.261212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.261406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deccb840-6166-4f4f-b692-e0c02eedea51" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.657660] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae: rpc.has_security_group_logging(os_id): False [ 1008.681201] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.681356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.681424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.681646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.681741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.681959] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.682072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.682139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.682288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.682795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.682795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.682795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.682795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.683080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.683080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.683080] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.686685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.686885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.687218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.687380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.687618] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be created. [ 1008.727960] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.728157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.728229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.728542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.728647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.728755] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3034974-c557-4de5-9753-a08e1f169c15 is going to be updated. [ 1008.770442] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.771775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.771775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.771775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.771775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.777203] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.777327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.777388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.777582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.777716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.786014] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: IN_PROGRESS for 2s [ 1008.786703] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 1008.851210] env[70032]: INFO networking_nsxv3.common.synchronization [req-8a154e21-e4cd-40be-9176-dd8b15495849 req-17e5bb64-e176-417c-ba7b-3beb903f5b67 tempest-ServersNegativeTestJSON-1561012911 tempest-ServersNegativeTestJSON-1561012911-project-member] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1008.851793] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1008.853349] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.853491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.853555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.853764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.853925] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.854032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.854092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.854237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.854323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.854455] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.312073] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.312073] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.312073] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.312073] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.312073] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.312073] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.312073] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.313887] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.314125] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.314358] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.314491] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.314584] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.314699] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.314814] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.314919] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.315068] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.333052] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.333052] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.333217] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.333339] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.333645] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.333816] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.333938] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.334361] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.334596] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b0af425-5db2-4cd4-892d-1e2c2e2b063c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.356533] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.723192] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1009.723423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.723588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.723822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.724015] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.724858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.724858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.724858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.724858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.724858] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.837620] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.837620] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.837985] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.837985] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.838141] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.838301] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 6b0af425-5db2-4cd4-892d-1e2c2e2b063c not found, creating... [ 1009.838585] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.838823] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.838984] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.839238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.839390] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.839699] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.839971] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.839971] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.840194] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.840335] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.840495] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 6b0af425-5db2-4cd4-892d-1e2c2e2b063c is going to be created. [ 1009.859257] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.859478] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.859648] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.859943] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.860225] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.860460] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.861305] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.226966] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.364383] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.364607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.364653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.364848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.364947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.365057] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be updated. [ 1010.395959] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.396124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.396192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.396422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.397148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.407469] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 1010.605937] env[70032]: INFO networking_nsxv3.common.synchronization [req-8a154e21-e4cd-40be-9176-dd8b15495849 req-01e76ffb-ba89-46ea-ab41-4204c294127f service nova] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_rules [ 1010.606464] env[70032]: INFO networking_nsxv3.common.synchronization [req-8a154e21-e4cd-40be-9176-dd8b15495849 req-01e76ffb-ba89-46ea-ab41-4204c294127f service nova] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1010.606464] env[70032]: INFO networking_nsxv3.common.synchronization [req-8a154e21-e4cd-40be-9176-dd8b15495849 req-01e76ffb-ba89-46ea-ab41-4204c294127f service nova] Enqueued Resource ID: 6b0af425-5db2-4cd4-892d-1e2c2e2b063c with Priority: HIGHEST for action port [ 1010.606648] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_rules [ 1010.606648] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1010.606740] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b0af425-5db2-4cd4-892d-1e2c2e2b063c with Priority: HIGHEST for action port [ 1010.607968] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.607968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.607968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.607968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.607968] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.608638] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.608638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.608836] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.608950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.609028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.609172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.609241] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b0af425-5db2-4cd4-892d-1e2c2e2b063c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.730020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.795938] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: SUCCESS [ 1010.796179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.799027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 1010.799202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.110951] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.111125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.111347] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b0af425-5db2-4cd4-892d-1e2c2e2b063c with status ACTIVE [ 1011.111526] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.111625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.111704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.111897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.111989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.112178] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.112275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.112337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.112491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.112568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.112752] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.112848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.112891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.113023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.113099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.113182] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b0af425-5db2-4cd4-892d-1e2c2e2b063c is going to be updated. [ 1011.133188] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.133677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.133677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.133677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.133785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.133917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b0af425-5db2-4cd4-892d-1e2c2e2b063c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.232801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.232966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.233056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.233286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.233382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.233486] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1011.268356] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.268486] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.268526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.269826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.269826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.278536] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1012.418808] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 1012.419243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.419346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.419636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.419848] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.420040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.420040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.420231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.420329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.420435] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.922274] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.289224] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1013.289453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.289629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.289869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.290081] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.290201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.290259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.290428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.290506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.290591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.290685] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.409750] env[70032]: INFO networking_nsxv3.common.synchronization [req-2ea385b2-c736-4285-a682-55ae0f6cf3eb req-8b9daf29-c6aa-4378-b369-b1d745ca256d tempest-ListServerFiltersTestJSON-951974945 tempest-ListServerFiltersTestJSON-951974945-project-member] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 1013.410346] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 1013.410657] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.410779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.410867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.415240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.415428] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.415543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.415611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.415788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.415877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.415975] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.424619] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.740433] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f6d9b8f-c82e-42d1-beab-a9fe9db867e1 req-eaca3db9-7071-49a8-a73f-e27827e32185 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_members [ 1013.741205] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_members [ 1013.741370] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.741449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.741493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.743521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.743521] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.743521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.743521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.743521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.743521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.743521] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.793341] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.793508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.793568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.793847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.793954] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.794069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.794126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.794273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.794366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.794452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.794598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.794691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.794757] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.794911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.795037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.795129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.795184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.795321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.795395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.795478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.795720] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.918276] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.927429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.927598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.927673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.927886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.927985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.928106] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be updated. [ 1013.959272] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.959547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.959547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.959732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.959878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.969610] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 1014.193332] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.193566] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.193668] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.195898] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.195898] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.195898] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.195898] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.195898] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.195898] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.195898] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.195898] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.195898] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.196276] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.196502] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.196502] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.196748] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.218192] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.218349] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.219167] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.219167] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.219167] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7b601013-bde1-4207-8131-85a560942e07 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.219167] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.220052] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.220052] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.220052] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b601013-bde1-4207-8131-85a560942e07',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.248510] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.248752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.248752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.249065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.249165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.249379] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.249481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.249550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.249712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.249790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.249875] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 already deleted. [ 1014.249957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.301904] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1d61d13-44e5-4c83-936b-8a6c378d760a: rpc.has_security_group_logging(os_id): False [ 1014.321739] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.321950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.321950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.322200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.322292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.322597] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.322725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.322793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.322908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.323026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.323202] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.323346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.323346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.323538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.323664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.323795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.323890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.323951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.324121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.324197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.324285] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1014.385696] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.385925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.385925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.386377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.386377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.399067] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1014.421034] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.722657] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.723203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.723203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.723484] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.723714] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.723897] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7b601013-bde1-4207-8131-85a560942e07 not found, creating... [ 1014.724194] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.724401] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.724553] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.724776] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.724923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.725397] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.725579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.725705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.726027] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.726090] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.726209] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7b601013-bde1-4207-8131-85a560942e07 is going to be created. [ 1014.749293] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.749531] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.749663] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.749970] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.750306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.750549] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.924858] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.924858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.924858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.924858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.924858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.924858] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 1014.967585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.967585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.967585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.967897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.967983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.981173] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 1015.531521] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f6d9b8f-c82e-42d1-beab-a9fe9db867e1 req-bceae96e-6c41-4a2c-a68b-5d6ae04282dc service nova] Enqueued Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_rules [ 1015.531786] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f6d9b8f-c82e-42d1-beab-a9fe9db867e1 req-bceae96e-6c41-4a2c-a68b-5d6ae04282dc service nova] Enqueued Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_members [ 1015.532891] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f6d9b8f-c82e-42d1-beab-a9fe9db867e1 req-bceae96e-6c41-4a2c-a68b-5d6ae04282dc service nova] Enqueued Resource ID: 7b601013-bde1-4207-8131-85a560942e07 with Priority: HIGHEST for action port [ 1015.533720] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_rules [ 1015.533840] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_members [ 1015.533840] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b601013-bde1-4207-8131-85a560942e07 with Priority: HIGHEST for action port [ 1015.534207] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.534280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.534418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.534677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.534762] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.537173] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.537173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.537173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.537408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.537691] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.537794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.537847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.538068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.538134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.538235] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.543274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b601013-bde1-4207-8131-85a560942e07 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.543274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.543274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.543274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.543274] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b601013-bde1-4207-8131-85a560942e07',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.979323] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 1015.979674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.979925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.980254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.980538] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.980740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.980853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.981476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.981645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.981801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.981961] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.001581] env[70032]: INFO networking_nsxv3.common.synchronization [req-066641be-80d4-47f6-9747-692eca63bf22 req-726a79d9-89d9-47d5-ba7a-13563dfdc861 tempest-ServerActionsV293TestJSON-1016486754 tempest-ServerActionsV293TestJSON-1016486754-project-member] Enqueued Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_members [ 1016.002132] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_members [ 1016.002443] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.002587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.002648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.002896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.003060] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.003162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.003261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.003374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.003457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.003550] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.036847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.037087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.041180] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.046911] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b601013-bde1-4207-8131-85a560942e07 with status ACTIVE [ 1016.047116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.047253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.047319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.047717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.047717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.047889] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.047977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.048042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.048199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.048273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.048471] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.048563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.048619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.048758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.048834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.048925] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b601013-bde1-4207-8131-85a560942e07 is going to be updated. [ 1016.071971] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.071971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.071971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.071971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.071971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.071971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b601013-bde1-4207-8131-85a560942e07" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.412940] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1016.413257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.485153] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.485298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.485375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.485594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.485782] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.485920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.485989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.486362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.486455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.486559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.486777] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.486891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.486980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.487132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.487287] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.487382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.487444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.487611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.487681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.487763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.487908] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.506199] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.506390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.506524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.506797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.506915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.507315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.507315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.507584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.507584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.507689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.507779] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c991b17e-e013-4122-96ca-aa291400f826 already deleted. [ 1016.507898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.544339] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.658149] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-306 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.658149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-306" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.658149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-306" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.658149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-306" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.658149] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.658149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.658149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.658149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.658149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.658149] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.658149] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.658149] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.658149] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.658715] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.659251] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.659251] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.676258] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.678448] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.678448] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.678448] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-306" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.678448] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-5959239e-365f-4cc1-9192-2ba7825bd9eb taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.678448] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.678448] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.678448] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.678448] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5959239e-365f-4cc1-9192-2ba7825bd9eb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.684915] env[70032]: INFO networking_nsxv3.common.synchronization [req-5a3b8456-75d8-43dc-b4bc-da1139d6b624 req-bacc88c3-eb3c-4602-bfb2-cc88a03993ba tempest-ImagesOneServerNegativeTestJSON-81621970 tempest-ImagesOneServerNegativeTestJSON-81621970-project-member] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 1016.685407] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGHEST for action security_group_members [ 1016.685701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.687100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.687100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.687100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.687242] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.687290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.687358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.687534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.687623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.687722] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.990038] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 1016.990313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.990522] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bccc08ea-f041-453a-b54a-615933f6cecf: rpc.has_security_group_logging(os_id): False [ 1017.005280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.005450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.005873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.006149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.006272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.006581] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.006708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.006769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.006955] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.007051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.008025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.008025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.008025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.008025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.008025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.008025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.008025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.008025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.008391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.008391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.008391] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be updated. [ 1017.048870] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.048870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.048870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.049181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.049181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.049865] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 is going to be created. [ 1017.066690] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.066943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.067034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.067393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.067700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.081096] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.081319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.081319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.081653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.081831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.083689] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 1017.090485] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0133496a-f61f-45f7-a024-b9b137774b66 in Status: UNINITIALIZED for 2s [ 1017.185260] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.185447] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.185884] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.185884] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.186027] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.186190] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 5959239e-365f-4cc1-9192-2ba7825bd9eb not found, creating... [ 1017.186940] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.186940] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.186940] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.187130] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.187160] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.187458] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.187627] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.187750] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.187990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.188164] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.188306] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 5959239e-365f-4cc1-9192-2ba7825bd9eb is going to be created. [ 1017.189619] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.189777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.189819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.190072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.190072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.190258] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.190369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.190462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.190588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.190710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.190817] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be updated. [ 1017.241170] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.241462] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.241599] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.242194] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.242194] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.242384] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.257261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.257562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.257562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.258227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.258227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.269255] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: IN_PROGRESS for 2s [ 1018.002101] env[70032]: INFO networking_nsxv3.common.synchronization [req-066641be-80d4-47f6-9747-692eca63bf22 req-cd6849f3-aaf3-4874-a6a4-7efeed2fcae6 service nova] Enqueued Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_rules [ 1018.002649] env[70032]: INFO networking_nsxv3.common.synchronization [req-066641be-80d4-47f6-9747-692eca63bf22 req-cd6849f3-aaf3-4874-a6a4-7efeed2fcae6 service nova] Enqueued Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_members [ 1018.003027] env[70032]: INFO networking_nsxv3.common.synchronization [req-066641be-80d4-47f6-9747-692eca63bf22 req-cd6849f3-aaf3-4874-a6a4-7efeed2fcae6 service nova] Enqueued Resource ID: 5959239e-365f-4cc1-9192-2ba7825bd9eb with Priority: HIGHEST for action port [ 1018.003646] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_rules [ 1018.003793] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_members [ 1018.003902] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5959239e-365f-4cc1-9192-2ba7825bd9eb with Priority: HIGHEST for action port [ 1018.004212] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.004630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.004869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.004963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.005099] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.006423] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.007545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.007545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.007545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.007545] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.007545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.007545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.007545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.007545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.007842] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.008973] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5959239e-365f-4cc1-9192-2ba7825bd9eb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.009138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.009226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.009432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.009574] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5959239e-365f-4cc1-9192-2ba7825bd9eb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.511352] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.515438] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5959239e-365f-4cc1-9192-2ba7825bd9eb with status ACTIVE [ 1018.515438] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.515438] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.515438] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.515438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.516051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5959239e-365f-4cc1-9192-2ba7825bd9eb is going to be updated. [ 1018.516411] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.539752] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.539752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.539752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.539752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.539752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.539752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5959239e-365f-4cc1-9192-2ba7825bd9eb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.021238] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.098672] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 1019.099160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.100186] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0133496a-f61f-45f7-a024-b9b137774b66 in Status: SUCCESS [ 1019.100394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.100586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.100922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.101250] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.101437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.101578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.101825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.101918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.102054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.102160] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.281247] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae in Status: SUCCESS [ 1019.281481] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae deletion is rescheduled due to dependency. [ 1019.281652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.523352] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.523519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.523592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.523808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.523897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.523995] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c991b17e-e013-4122-96ca-aa291400f826 is going to be created. [ 1019.544481] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.544674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.544751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.544964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.545133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.552866] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c991b17e-e013-4122-96ca-aa291400f826 in Status: UNINITIALIZED for 2s [ 1019.606072] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.109563] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0133496a-f61f-45f7-a024-b9b137774b66: rpc.has_security_group_logging(os_id): False [ 1020.131661] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.131661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.132019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.132019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.132149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.132380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.132858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.132858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.132858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.132858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.133439] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 is going to be created. [ 1020.212715] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.212894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.212978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.213237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.213445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.247420] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0133496a-f61f-45f7-a024-b9b137774b66 in Status: IN_PROGRESS for 2s [ 1021.562854] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c991b17e-e013-4122-96ca-aa291400f826 in Status: SUCCESS [ 1021.563149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.563299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.563523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.563703] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.563829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.563891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.564073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.564173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.564277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.564487] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.068796] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.259822] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0133496a-f61f-45f7-a024-b9b137774b66 in Status: SUCCESS [ 1022.259822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.571161] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c991b17e-e013-4122-96ca-aa291400f826: rpc.has_security_group_logging(os_id): False [ 1022.593302] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.593555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.593555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.593746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.593831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.594099] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.594239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.594378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.594477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.594527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.594646] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c991b17e-e013-4122-96ca-aa291400f826 is going to be created. [ 1022.652161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.652161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.652161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.652317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.652453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.663547] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c991b17e-e013-4122-96ca-aa291400f826 in Status: IN_PROGRESS for 2s [ 1023.005448] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1023.005448] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1023.609187] env[70032]: INFO networking_nsxv3.common.synchronization [req-92b6283f-30e7-4366-8720-e1c9616a2459 req-ce64d1bf-92ef-4fb8-bad0-fb6d52f1d5ea tempest-ServersNegativeTestJSON-1561012911 tempest-ServersNegativeTestJSON-1561012911-project-member] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1023.609187] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1023.609187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.609187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.609187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.609187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.609187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.611251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.611365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.611549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.611673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.611958] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.118026] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.620113] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.679243] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c991b17e-e013-4122-96ca-aa291400f826 in Status: SUCCESS [ 1024.679243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.123335] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.123492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.123615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.123790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.123882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.124094] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be updated. [ 1025.167140] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.167140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.167140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.167140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.167335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.179150] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 1026.080260] env[70032]: INFO networking_nsxv3.common.synchronization [req-4c90fc4c-7de5-4f7a-8617-f9352fb18c0b req-0b73fa0c-2cb8-414d-9510-7538ae5f6f93 tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1026.081463] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1026.081463] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.081463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.081463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.081826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.081826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.081826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.081826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.081950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.082059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.082225] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.586289] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.087632] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.191236] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 1027.191462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.547943] env[70032]: INFO networking_nsxv3.common.synchronization [req-347cc1cf-15ab-422c-a3c2-3815eb1c2b4c req-d3b8a874-46c0-4bb3-a64d-72eca3e9750e tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1027.548526] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1027.548843] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.548960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.550031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.550031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.550031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.550031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.550304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.550304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.550304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.550419] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.590425] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.590637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.590697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.590916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.590994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.591104] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1027.618208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.618208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.618208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.618208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.618208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.626102] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1027.809893] env[70032]: INFO networking_nsxv3.common.synchronization [req-51c6f521-d0d2-4642-b9fd-2b8e88d7a7a7 req-a3801f7e-8111-45a8-9ce5-b93c8739a324 tempest-MigrationsAdminTest-411767673 tempest-MigrationsAdminTest-411767673-project-member] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 1027.810291] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGHEST for action security_group_members [ 1027.810761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.810761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.810878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.811011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.811322] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.811477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.811511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.812175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.812280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.812384] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.942117] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.942324] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.942454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.942737] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.943009] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.943206] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.943329] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.943562] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.943710] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.943936] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.946692] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.946692] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.946692] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.946692] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.946692] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.946692] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.963437] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.963437] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.963572] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.963727] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.964051] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-621c24c7-2edb-4abe-ab56-9a45823b79d8 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.964282] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.964347] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.966814] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.966814] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('621c24c7-2edb-4abe-ab56-9a45823b79d8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.054213] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.055423] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.055423] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 already deleted. [ 1028.055423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317913] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317913] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.317913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be updated. [ 1028.345686] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.345686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.345686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.345686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.345686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.352304] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: IN_PROGRESS for 2s [ 1028.467933] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.468170] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.468297] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.468610] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.468792] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.468963] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 621c24c7-2edb-4abe-ab56-9a45823b79d8 not found, creating... [ 1028.469289] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.469463] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.469588] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.469825] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.469966] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.470283] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.470466] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.470558] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.470766] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.470921] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.471074] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 621c24c7-2edb-4abe-ab56-9a45823b79d8 is going to be created. [ 1028.489108] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.489328] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.489472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.489732] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.489956] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.490195] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.250155] env[70032]: INFO networking_nsxv3.common.synchronization [req-347cc1cf-15ab-422c-a3c2-3815eb1c2b4c req-a891393a-b1f9-49de-84cf-3f54c19e2d5d service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 1029.250155] env[70032]: INFO networking_nsxv3.common.synchronization [req-347cc1cf-15ab-422c-a3c2-3815eb1c2b4c req-a891393a-b1f9-49de-84cf-3f54c19e2d5d service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1029.250155] env[70032]: INFO networking_nsxv3.common.synchronization [req-347cc1cf-15ab-422c-a3c2-3815eb1c2b4c req-a891393a-b1f9-49de-84cf-3f54c19e2d5d service nova] Enqueued Resource ID: 621c24c7-2edb-4abe-ab56-9a45823b79d8 with Priority: HIGHEST for action port [ 1029.251429] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 1029.253331] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1029.253331] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621c24c7-2edb-4abe-ab56-9a45823b79d8 with Priority: HIGHEST for action port [ 1029.253331] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.255478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.255478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.255478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.255478] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.259573] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.259573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.259573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.259573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.259573] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.259573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.259573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.259573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.259573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.259573] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.263485] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-621c24c7-2edb-4abe-ab56-9a45823b79d8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.263485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.263485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.263485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.263485] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('621c24c7-2edb-4abe-ab56-9a45823b79d8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.636535] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1029.636813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.757857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.758267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.767427] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.768456] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 621c24c7-2edb-4abe-ab56-9a45823b79d8 with status ACTIVE [ 1029.770747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.770747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.770747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.770747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.770747] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 621c24c7-2edb-4abe-ab56-9a45823b79d8 is going to be updated. [ 1029.789857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.790015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.790100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.790343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.790499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.790660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-621c24c7-2edb-4abe-ab56-9a45823b79d8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.269058] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.376578] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1393cc3-6b9b-4326-8077-4648511fe41e in Status: SUCCESS [ 1030.376953] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e deletion is rescheduled due to dependency. [ 1030.377139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.773555] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.773888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.773888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.774489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.774489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.774489] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 1030.790281] env[70032]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'data': {'id': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'display_name': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'path': '/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'expression': [{'value': 'security_group|1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['192.168.128.7']}], 'tags': [{'scope': 'age', 'tag': 1743816044}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500127,\n "module_name" : "Policy",\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\n}' [ 1030.790281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.790488] env[70032]: Traceback (most recent call last): [ 1030.790536] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1030.790536] env[70032]: listener.cb(fileno) [ 1030.790536] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1030.790536] env[70032]: result = function(*args, **kwargs) [ 1030.790536] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 178, in security_group_members [ 1030.790536] env[70032]: self.nsx_provider.sg_members_realize( [ 1030.790536] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1030, in sg_members_realize [ 1030.790536] env[70032]: return self._realize(Provider.SG_MEMBERS, delete, self.payload.sg_members_container, os_sg, provider_group) [ 1030.790536] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1030.790536] env[70032]: return func(*args, **kwargs) [ 1030.790536] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 785, in _realize [ 1030.790536] env[70032]: res = self.client.put(path=path, data=data) [ 1030.790536] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 125, in decorator [ 1030.790536] env[70032]: raise RuntimeError(msg, last_err) [ 1030.790536] env[70032]: RuntimeError: (None, 'Error Code=400 Message=b\'{\\n "httpStatus" : "BAD_REQUEST",\\n "error_code" : 500127,\\n "module_name" : "Policy",\\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\\n}\'') [ 1030.790536] env[70032]: Removing descriptor: 64 [ 1030.791020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.791020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.791202] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.791322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.791389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.791536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.791619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.791716] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.294447] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.800047] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.304800] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.304800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.304800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.304800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.304800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.304800] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 1032.319207] env[70032]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'data': {'id': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'display_name': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'path': '/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'expression': [{'value': 'security_group|1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['192.168.128.7']}], 'tags': [{'scope': 'age', 'tag': 1743816046}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500127,\n "module_name" : "Policy",\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\n}' [ 1032.319207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.319207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.319207] env[70032]: Traceback (most recent call last): [ 1032.319207] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1032.319207] env[70032]: listener.cb(fileno) [ 1032.319207] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1032.319207] env[70032]: result = function(*args, **kwargs) [ 1032.319207] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 194, in security_group_rules [ 1032.319207] env[70032]: self.security_group_members(os_id, reference=True) [ 1032.319207] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 178, in security_group_members [ 1032.319207] env[70032]: self.nsx_provider.sg_members_realize( [ 1032.319207] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1030, in sg_members_realize [ 1032.319207] env[70032]: return self._realize(Provider.SG_MEMBERS, delete, self.payload.sg_members_container, os_sg, provider_group) [ 1032.319207] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1032.319207] env[70032]: return func(*args, **kwargs) [ 1032.319207] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 785, in _realize [ 1032.319207] env[70032]: res = self.client.put(path=path, data=data) [ 1032.319207] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 125, in decorator [ 1032.319207] env[70032]: raise RuntimeError(msg, last_err) [ 1032.319207] env[70032]: RuntimeError: (None, 'Error Code=400 Message=b\'{\\n "httpStatus" : "BAD_REQUEST",\\n "error_code" : 500127,\\n "module_name" : "Policy",\\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\\n}\'') [ 1032.319207] env[70032]: Removing descriptor: 64 [ 1032.405021] env[70032]: INFO networking_nsxv3.common.synchronization [req-561aee97-89fa-42dd-a1ae-cd554e5bdda7 req-927cdfd8-f27f-4a56-8005-a3367da62e5d tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1032.405021] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1032.405021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.405021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.405021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.405021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.405021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.405491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.405679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.405979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.406206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.406405] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.908967] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.914606] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.914817] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.914948] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.915265] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.915507] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.915674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.915798] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.916102] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.916296] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.916545] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.916735] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.916890] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.917046] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.917212] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.921252] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.921430] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.941219] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.941369] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.941514] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.942108] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.942108] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-68968528-ab4a-4f21-b95f-5c4ac91a6806 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.942261] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.942574] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.942754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.942911] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68968528-ab4a-4f21-b95f-5c4ac91a6806',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.412421] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.445973] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.446375] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.446643] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.447019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.447250] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.447555] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 68968528-ab4a-4f21-b95f-5c4ac91a6806 not found, creating... [ 1033.447943] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.448195] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.448513] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.448878] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.449060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.449468] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.449712] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.449905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.450236] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.450450] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.450664] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 68968528-ab4a-4f21-b95f-5c4ac91a6806 is going to be created. [ 1033.470618] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.471080] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.471080] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.471445] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.471707] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.471989] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.914888] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.914888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.914888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.915225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.915225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.915302] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 1033.944207] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.944360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.944431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.944649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.944796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.953942] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 1034.188245] env[70032]: INFO networking_nsxv3.common.synchronization [req-561aee97-89fa-42dd-a1ae-cd554e5bdda7 req-9ff3b871-d7f5-4579-80a9-91afc1a6607f service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 1034.188245] env[70032]: INFO networking_nsxv3.common.synchronization [req-561aee97-89fa-42dd-a1ae-cd554e5bdda7 req-9ff3b871-d7f5-4579-80a9-91afc1a6607f service nova] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1034.188245] env[70032]: INFO networking_nsxv3.common.synchronization [req-561aee97-89fa-42dd-a1ae-cd554e5bdda7 req-9ff3b871-d7f5-4579-80a9-91afc1a6607f service nova] Enqueued Resource ID: 68968528-ab4a-4f21-b95f-5c4ac91a6806 with Priority: HIGHEST for action port [ 1034.188245] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_rules [ 1034.188245] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1034.190029] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68968528-ab4a-4f21-b95f-5c4ac91a6806 with Priority: HIGHEST for action port [ 1034.190029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.190216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.190473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.190551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.190656] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.191535] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.191815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.192147] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-68968528-ab4a-4f21-b95f-5c4ac91a6806 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.192260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.192327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.192509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.192590] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68968528-ab4a-4f21-b95f-5c4ac91a6806',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.695082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.695239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.695418] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68968528-ab4a-4f21-b95f-5c4ac91a6806 with status ACTIVE [ 1034.695596] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.695701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.695766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.695981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.696085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.696255] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.696353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.696415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.696567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.696706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.696899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.696996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.697069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.697214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.697291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.697375] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68968528-ab4a-4f21-b95f-5c4ac91a6806 is going to be updated. [ 1034.717249] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.717401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.717447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.717587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.717783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.717936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68968528-ab4a-4f21-b95f-5c4ac91a6806" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.573759] env[70032]: INFO networking_nsxv3.common.synchronization [req-da331854-e3e2-4660-b93f-60c41d05dc47 req-85c192a7-b5f9-41aa-8d3d-4cb3874348ce tempest-VolumesAssistedSnapshotsTest-1282546720 tempest-VolumesAssistedSnapshotsTest-1282546720-project-member] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_members [ 1035.573759] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGHEST for action security_group_members [ 1035.574090] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.574090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.574954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.575631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.575922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.576199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.576877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.576877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.576877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.576877] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.964562] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1035.965571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.965832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.966118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.966315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.966522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.966522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.966755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.966755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.966844] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.055319] env[70032]: INFO networking_nsxv3.common.synchronization [req-583fccf4-6212-4204-a9f5-2ae879769677 req-b2ef6d70-8bbd-45d7-ae56-c620fc660b87 tempest-ListImageFiltersTestJSON-2030612318 tempest-ListImageFiltersTestJSON-2030612318-project-member] Enqueued Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 1036.055930] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3034974-c557-4de5-9753-a08e1f169c15 with Priority: HIGHEST for action security_group_members [ 1036.056869] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3034974-c557-4de5-9753-a08e1f169c15 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.057186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.057186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.058393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.058580] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.058713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.058818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.058935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.059034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.059130] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3034974-c557-4de5-9753-a08e1f169c15',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.079352] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.079527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.079601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.079817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.079929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.080198] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.080311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.080377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.080537] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.080606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.080719] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f is going to be updated. [ 1036.112295] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.112295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.112295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.112295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.112295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.129892] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: IN_PROGRESS for 2s [ 1036.473639] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.561377] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.561511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.561578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.561784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.561872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.562079] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.562843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.562843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.562843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.562843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.562843] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3034974-c557-4de5-9753-a08e1f169c15 is going to be updated. [ 1036.591933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.591933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.592250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.592830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.592830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.605478] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: IN_PROGRESS for 2s [ 1036.976282] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.477588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.477800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.477877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.478496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.478496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.478496] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 1037.515829] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.516030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.516072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.516326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.516481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.527839] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 1038.142288] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: IN_PROGRESS for 4s [ 1038.615288] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3034974-c557-4de5-9753-a08e1f169c15 in Status: SUCCESS [ 1038.616601] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3034974-c557-4de5-9753-a08e1f169c15 deletion is rescheduled due to dependency. [ 1038.616601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3034974-c557-4de5-9753-a08e1f169c15" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.537495] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1039.537829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.537911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.538151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.538349] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.538465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.538534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.538680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.538772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.538860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.538952] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.912035] env[70032]: INFO networking_nsxv3.common.synchronization [req-e8d7bc41-0ccb-4b07-80ce-6fe2f160f53b req-9a4d43ab-6d7a-4d52-800e-543e5bd0b006 tempest-ListServerFiltersTestJSON-951974945 tempest-ListServerFiltersTestJSON-951974945-project-member] Enqueued Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 1039.912580] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 with Priority: HIGHEST for action security_group_members [ 1039.912928] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d217ae0-b74a-4bed-9ca6-45df455c7a58 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.913404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.913493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.913711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.913870] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.913986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.914072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.914239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.914324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.914432] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d217ae0-b74a-4bed-9ca6-45df455c7a58',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.041576] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.042817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.042817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.042817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.043159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.043159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.043159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.043433] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.043433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.043433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.043536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.043565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.043666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.043754] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.153468] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57166f3a-68e3-48b8-984a-2376cb60573f in Status: SUCCESS [ 1040.153743] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f deletion is rescheduled due to dependency. [ 1040.153913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.416214] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.416387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.416387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.416595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.416743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.416963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.417089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.417142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.417293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.417387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.417479] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 is going to be updated. [ 1040.503348] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.503494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.503540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.503748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.503902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.522936] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: IN_PROGRESS for 2s [ 1040.548421] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 750167f1-a8ae-4a8e-a9a0-cd5ce2550684: rpc.has_security_group_logging(os_id): False [ 1040.573564] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.573758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.573803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.573999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.574109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.574309] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.574412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.574467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.574667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.574732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.574945] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.575439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.575723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.575911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.576030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.576379] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.576585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.576659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.576839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.576923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.577487] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 1040.663731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.663964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.664054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.664277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.664421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.709568] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 1041.232718] env[70032]: INFO networking_nsxv3.common.synchronization [req-99d44d94-2cfa-45eb-961b-c451195dc75b req-9361be44-2585-4ce4-a82c-3d8e91ef8a68 tempest-ServerRescueTestJSON-709973283 tempest-ServerRescueTestJSON-709973283-project-member] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1041.234224] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1041.234658] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.234804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.234877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.235053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.235208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.235301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.235374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.235552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.235688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.235737] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.590655] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.590655] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.590655] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.591035] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.591862] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.591862] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.591862] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.592258] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.592258] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.592911] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.592911] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.592911] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.592911] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.592911] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.593099] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.593099] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.620179] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.621449] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.621623] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.621832] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-431" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.622186] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-e3296a42-ebae-4f53-a8a9-d00189e7db21 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.622368] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.622491] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.622808] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.622951] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3296a42-ebae-4f53-a8a9-d00189e7db21',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.739410] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.128590] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.128590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.128590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.128590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.128590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.128590] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port e3296a42-ebae-4f53-a8a9-d00189e7db21 not found, creating... [ 1042.128590] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.128590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.128981] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.128981] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.129179] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.129557] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.129763] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.129929] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.130231] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.130417] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.130572] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: e3296a42-ebae-4f53-a8a9-d00189e7db21 is going to be created. [ 1042.151619] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.151825] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.151978] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.152358] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.152623] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.152927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.243741] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.532882] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 in Status: SUCCESS [ 1042.533172] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d217ae0-b74a-4bed-9ca6-45df455c7a58 deletion is rescheduled due to dependency. [ 1042.533218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d217ae0-b74a-4bed-9ca6-45df455c7a58" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.724934] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1042.725230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.750430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.750430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.750664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.750905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.751033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.751144] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be updated. [ 1042.782101] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.782259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.782335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.782581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.782807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.792361] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: IN_PROGRESS for 2s [ 1042.928270] env[70032]: INFO networking_nsxv3.common.synchronization [req-99d44d94-2cfa-45eb-961b-c451195dc75b req-44f2c204-10e3-4515-af73-79c4ec4bd050 service nova] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_rules [ 1042.928468] env[70032]: INFO networking_nsxv3.common.synchronization [req-99d44d94-2cfa-45eb-961b-c451195dc75b req-44f2c204-10e3-4515-af73-79c4ec4bd050 service nova] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1042.928616] env[70032]: INFO networking_nsxv3.common.synchronization [req-99d44d94-2cfa-45eb-961b-c451195dc75b req-44f2c204-10e3-4515-af73-79c4ec4bd050 service nova] Enqueued Resource ID: e3296a42-ebae-4f53-a8a9-d00189e7db21 with Priority: HIGHEST for action port [ 1042.929269] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_rules [ 1042.929396] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1042.929487] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3296a42-ebae-4f53-a8a9-d00189e7db21 with Priority: HIGHEST for action port [ 1042.929812] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.929929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.930015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.930237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.930335] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.931251] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.931367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.931798] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3296a42-ebae-4f53-a8a9-d00189e7db21 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.931798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.931798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.932047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.932047] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3296a42-ebae-4f53-a8a9-d00189e7db21',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.434312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.437051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3296a42-ebae-4f53-a8a9-d00189e7db21 with status ACTIVE [ 1043.437051] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.437051] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.437051] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.437051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.440752] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3296a42-ebae-4f53-a8a9-d00189e7db21 is going to be updated. [ 1043.467263] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.467263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.467263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.467263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.467263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.467263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3296a42-ebae-4f53-a8a9-d00189e7db21" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.848328] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1e9ba71b-d8f7-44ec-b97d-9e4fe06045dc None None] Enqueued Resource ID: 1c5190b6-82ef-4162-a5ff-18ed169e114e with Priority: HIGHEST for action port [ 1043.848606] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c5190b6-82ef-4162-a5ff-18ed169e114e with Priority: HIGHEST for action port [ 1043.849224] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c5190b6-82ef-4162-a5ff-18ed169e114e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.849349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c5190b6-82ef-4162-a5ff-18ed169e114e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.849414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c5190b6-82ef-4162-a5ff-18ed169e114e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.850396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c5190b6-82ef-4162-a5ff-18ed169e114e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.850396] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c5190b6-82ef-4162-a5ff-18ed169e114e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.080023] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-523e2bf4-90d6-4f0d-b52d-330d0c209f74 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1044.080023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1044.080023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.080023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.080023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.080023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.080023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.080023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.080023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.080023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.080023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.080023] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.354031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c5190b6-82ef-4162-a5ff-18ed169e114e [ 1044.354031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.354031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.354031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.354031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.354031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.354031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c5190b6-82ef-4162-a5ff-18ed169e114e already deleted. [ 1044.354031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c5190b6-82ef-4162-a5ff-18ed169e114e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.583826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.583994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.584081] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.584297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.584392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.584588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.584685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.584749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.584950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.585048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.585138] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1044.618016] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.618016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.618016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.618016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.618016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.625502] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1044.738685] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-4b306cbb-cd59-47e6-9b4a-956b30c3c8ed tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1044.742014] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1044.742014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.742014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.802737] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: SUCCESS [ 1044.803173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.803173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.803543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.803543] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.803640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.804221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.804221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.804221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.804221] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.126895] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.127411] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-888" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.127411] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-888" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.127618] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-888" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.127937] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.128808] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.129123] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.130122] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.130934] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.131335] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1045.131634] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.131871] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.132167] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.132738] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1045.132927] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.133169] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.154029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.154029] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1045.154029] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.154029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-888" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.154029] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-ad8d279b-42f9-482d-92a1-499f64ff4bd9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.154029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.154029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.154029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.154029] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad8d279b-42f9-482d-92a1-499f64ff4bd9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.311315] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.493550] env[70032]: INFO networking_nsxv3.common.synchronization [req-4eb811da-0ee8-4b55-91c9-82e768224d8c req-fa2fe274-9565-4e07-ac9a-342a3e7c7941 tempest-SecurityGroupRulesTestJSON-697413070 tempest-SecurityGroupRulesTestJSON-697413070-project-member] Enqueued Resource ID: 4febcd65-b9a8-45da-b3ee-c31a6e74e4ed with Priority: HIGHEST for action security_group_rules [ 1045.493550] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4febcd65-b9a8-45da-b3ee-c31a6e74e4ed with Priority: HIGHEST for action security_group_rules [ 1045.493550] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4febcd65-b9a8-45da-b3ee-c31a6e74e4ed taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.493550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4febcd65-b9a8-45da-b3ee-c31a6e74e4ed" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.493550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4febcd65-b9a8-45da-b3ee-c31a6e74e4ed" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.493550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4febcd65-b9a8-45da-b3ee-c31a6e74e4ed" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.493550] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4febcd65-b9a8-45da-b3ee-c31a6e74e4ed',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.656648] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.657018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.657201] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.657524] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.657718] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.657922] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port ad8d279b-42f9-482d-92a1-499f64ff4bd9 not found, creating... [ 1045.659280] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.659280] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.659280] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.659280] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.659280] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.659530] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.659530] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.659611] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.660386] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.660567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.660733] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: ad8d279b-42f9-482d-92a1-499f64ff4bd9 is going to be created. [ 1045.683602] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.683741] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.683877] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.684177] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.684401] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.689301] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.793689] env[70032]: INFO networking_nsxv3.common.synchronization [req-4de0cca4-6bb7-496c-a952-39b6de3ca16b req-b9912502-9468-4ca8-9045-efbde3531f32 tempest-SecurityGroupRulesTestJSON-697413070 tempest-SecurityGroupRulesTestJSON-697413070-project-member] Enqueued Resource ID: 84b7e9c3-df6c-4098-89f4-a08617d29aa5 with Priority: HIGHEST for action security_group_rules [ 1045.793689] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84b7e9c3-df6c-4098-89f4-a08617d29aa5 with Priority: HIGHEST for action security_group_rules [ 1045.794787] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84b7e9c3-df6c-4098-89f4-a08617d29aa5 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.794787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84b7e9c3-df6c-4098-89f4-a08617d29aa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.794787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84b7e9c3-df6c-4098-89f4-a08617d29aa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.794787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84b7e9c3-df6c-4098-89f4-a08617d29aa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.794787] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84b7e9c3-df6c-4098-89f4-a08617d29aa5',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.814097] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.982281] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d8ebeaa9-96cd-429b-b692-d59145231a9e None None] Enqueued Resource ID: a3168850-fc1b-42b1-aa83-ac9834d244c0 with Priority: HIGHEST for action port [ 1045.982387] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3168850-fc1b-42b1-aa83-ac9834d244c0 with Priority: HIGHEST for action port [ 1045.983201] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3168850-fc1b-42b1-aa83-ac9834d244c0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.983330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3168850-fc1b-42b1-aa83-ac9834d244c0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.983411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3168850-fc1b-42b1-aa83-ac9834d244c0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.983794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3168850-fc1b-42b1-aa83-ac9834d244c0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.984040] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3168850-fc1b-42b1-aa83-ac9834d244c0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.011446] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.011590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.011661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.011939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.011939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.012082] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4febcd65-b9a8-45da-b3ee-c31a6e74e4ed already deleted. [ 1046.012154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4febcd65-b9a8-45da-b3ee-c31a6e74e4ed" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.175063] env[70032]: INFO networking_nsxv3.common.synchronization [req-f9c672dc-0de5-43fa-8ced-09454909eb2c req-ef33f16d-a5e3-44a9-9cbb-c5930f9d6ff3 tempest-SecurityGroupRulesTestJSON-697413070 tempest-SecurityGroupRulesTestJSON-697413070-project-member] Enqueued Resource ID: b72ac7ea-a65f-407a-9754-937916c45914 with Priority: HIGHEST for action security_group_rules [ 1046.176904] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72ac7ea-a65f-407a-9754-937916c45914 with Priority: HIGHEST for action security_group_rules [ 1046.176904] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b72ac7ea-a65f-407a-9754-937916c45914 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.176904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b72ac7ea-a65f-407a-9754-937916c45914" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.176904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b72ac7ea-a65f-407a-9754-937916c45914" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.176904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b72ac7ea-a65f-407a-9754-937916c45914" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.176904] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b72ac7ea-a65f-407a-9754-937916c45914',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.318954] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.318954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.318954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.318954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.318954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.318954] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be updated. [ 1046.320925] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.321816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.321816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.321816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.321816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.321816] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84b7e9c3-df6c-4098-89f4-a08617d29aa5 already deleted. [ 1046.321816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84b7e9c3-df6c-4098-89f4-a08617d29aa5" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.346802] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.346802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.346802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.346802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.346802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.353742] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: IN_PROGRESS for 2s [ 1046.489034] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3168850-fc1b-42b1-aa83-ac9834d244c0 [ 1046.489034] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.489034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.489034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.489034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.489034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.489034] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3168850-fc1b-42b1-aa83-ac9834d244c0 already deleted. [ 1046.489034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3168850-fc1b-42b1-aa83-ac9834d244c0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.489034] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-25cb36ef-1813-42f2-9868-7c554512f475 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 1046.489034] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-25cb36ef-1813-42f2-9868-7c554512f475 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1046.489034] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-25cb36ef-1813-42f2-9868-7c554512f475 service nova] Enqueued Resource ID: ad8d279b-42f9-482d-92a1-499f64ff4bd9 with Priority: HIGHEST for action port [ 1046.489034] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 1046.489034] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1046.489034] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8d279b-42f9-482d-92a1-499f64ff4bd9 with Priority: HIGHEST for action port [ 1046.490531] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.490918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.491105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.491398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.491611] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.493291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.493291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.493291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad8d279b-42f9-482d-92a1-499f64ff4bd9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.493291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.493291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.493291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.493529] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad8d279b-42f9-482d-92a1-499f64ff4bd9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.595726] env[70032]: INFO networking_nsxv3.common.synchronization [req-5f906881-7b89-473d-99fe-19535b56365d req-0dc60b79-f538-47d6-a5e7-cc00dec9788c tempest-SecurityGroupRulesTestJSON-697413070 tempest-SecurityGroupRulesTestJSON-697413070-project-member] Enqueued Resource ID: d3d4703c-37e0-4bc2-a1c0-696353c28ea9 with Priority: HIGHEST for action security_group_rules [ 1046.596041] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3d4703c-37e0-4bc2-a1c0-696353c28ea9 with Priority: HIGHEST for action security_group_rules [ 1046.596344] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3d4703c-37e0-4bc2-a1c0-696353c28ea9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.596482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3d4703c-37e0-4bc2-a1c0-696353c28ea9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.596574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3d4703c-37e0-4bc2-a1c0-696353c28ea9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.597117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3d4703c-37e0-4bc2-a1c0-696353c28ea9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.597117] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3d4703c-37e0-4bc2-a1c0-696353c28ea9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.636484] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1046.636484] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 deletion is rescheduled due to dependency. [ 1046.636484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.636907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.637145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.637429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.637429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.637552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.637644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.637713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.637839] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.695808] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.696134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.696134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.696336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.696385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.696458] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b72ac7ea-a65f-407a-9754-937916c45914 already deleted. [ 1046.696531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b72ac7ea-a65f-407a-9754-937916c45914" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.995293] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.995419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.996782] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad8d279b-42f9-482d-92a1-499f64ff4bd9 with status ACTIVE [ 1046.997095] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.997313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.997313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.997492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.997584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.997759] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.997855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.999055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.999055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.999055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.999055] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.999055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.999055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.999055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.999055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.999055] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad8d279b-42f9-482d-92a1-499f64ff4bd9 is going to be updated. [ 1047.031606] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.031752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.031871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.032061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.032216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.032374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad8d279b-42f9-482d-92a1-499f64ff4bd9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.128616] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.128616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.128616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.128616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.128616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.128616] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3d4703c-37e0-4bc2-a1c0-696353c28ea9 already deleted. [ 1047.128616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3d4703c-37e0-4bc2-a1c0-696353c28ea9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.140515] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.391157] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-415 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.391491] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-415" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.391534] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-415" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.391859] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-415" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.392144] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.392620] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.392797] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.393047] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.393210] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.393431] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.393550] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.393665] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.393781] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.393891] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.394000] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.394153] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.416027] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.416027] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.416027] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.416027] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-415" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.416027] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-323c937c-95d9-4d25-aa02-77e1b8d10082 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.416571] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.416571] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.416656] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.416791] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('323c937c-95d9-4d25-aa02-77e1b8d10082',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.511949] env[70032]: INFO networking_nsxv3.common.synchronization [req-69567273-4362-4381-81cf-4c99d6be08ca req-af5a3adf-9cb2-4038-9b85-d77e2a646dd0 tempest-SecurityGroupRulesTestJSON-697413070 tempest-SecurityGroupRulesTestJSON-697413070-project-member] Enqueued Resource ID: 2a77a8e2-3651-49e0-b208-988a23ca643d with Priority: HIGHEST for action security_group_rules [ 1047.512074] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a77a8e2-3651-49e0-b208-988a23ca643d with Priority: HIGHEST for action security_group_rules [ 1047.512425] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a77a8e2-3651-49e0-b208-988a23ca643d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.512592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.512704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.513104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.513201] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a77a8e2-3651-49e0-b208-988a23ca643d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.635615] env[70032]: INFO networking_nsxv3.common.synchronization [req-4a888078-f567-46ca-bcd5-970955fd6e6b req-776dba78-5c74-4dcf-b37a-a2dcc6069f39 tempest-SecurityGroupRulesTestJSON-697413070 tempest-SecurityGroupRulesTestJSON-697413070-project-member] Enqueued Resource ID: 2a77a8e2-3651-49e0-b208-988a23ca643d with Priority: HIGHEST for action security_group_rules [ 1047.635615] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a77a8e2-3651-49e0-b208-988a23ca643d with Priority: HIGHEST for action security_group_rules [ 1047.635615] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a77a8e2-3651-49e0-b208-988a23ca643d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.635615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.642222] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.919504] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.919691] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.919828] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.920134] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.920287] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.920445] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 323c937c-95d9-4d25-aa02-77e1b8d10082 not found, creating... [ 1047.920703] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.920895] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.921034] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.921265] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.921761] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.922123] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.922273] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.922578] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.922634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.922740] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.922887] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 323c937c-95d9-4d25-aa02-77e1b8d10082 is going to be created. [ 1047.944031] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.944031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.944218] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.944404] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.944634] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.944861] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.043984] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.044116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.044201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.044448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.044568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.044710] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a77a8e2-3651-49e0-b208-988a23ca643d already deleted. [ 1048.044812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.044955] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.045157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.045276] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a77a8e2-3651-49e0-b208-988a23ca643d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.144627] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.144880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.145056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.145267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.145401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.145557] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1048.176632] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.176905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.176905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.177068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.177240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.186181] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1048.356713] env[70032]: INFO networking_nsxv3.common.synchronization [req-dabe6cdf-3512-4f0e-aba0-19b89ce26ee5 req-acab04c7-dbe3-45d6-94dd-ac2044025fcc tempest-SecurityGroupRulesTestJSON-697413070 tempest-SecurityGroupRulesTestJSON-697413070-project-member] Enqueued Resource ID: 2a77a8e2-3651-49e0-b208-988a23ca643d with Priority: HIGHEST for action security_group_rules [ 1048.357520] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a77a8e2-3651-49e0-b208-988a23ca643d with Priority: HIGHEST for action security_group_rules [ 1048.358163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a77a8e2-3651-49e0-b208-988a23ca643d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.358832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.367511] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: SUCCESS [ 1048.367511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.367707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.367963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.368198] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.368355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.368422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.368639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.368765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.368885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.369021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.643382] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.643797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.643797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.643797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.643889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.644071] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a77a8e2-3651-49e0-b208-988a23ca643d already deleted. [ 1048.644071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.644215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.644372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.644456] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a77a8e2-3651-49e0-b208-988a23ca643d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.872527] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.872790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.872920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.873237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.873480] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.873640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.873758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.873987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.875388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.875388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.875388] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.875388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.875388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.876042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.876248] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.876442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.880018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.880018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.880018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.880018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.880018] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.036063] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-7aafedfb-4a84-4eb0-b72a-75b7012ac9f4 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 1049.036063] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-7aafedfb-4a84-4eb0-b72a-75b7012ac9f4 service nova] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1049.036284] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddd81d12-d9de-48a5-905f-19acfd10dcf4 req-7aafedfb-4a84-4eb0-b72a-75b7012ac9f4 service nova] Enqueued Resource ID: 323c937c-95d9-4d25-aa02-77e1b8d10082 with Priority: HIGHEST for action port [ 1049.036936] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_rules [ 1049.037617] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1049.037786] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c937c-95d9-4d25-aa02-77e1b8d10082 with Priority: HIGHEST for action port [ 1049.038205] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.038351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.038638] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.038762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.039038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-323c937c-95d9-4d25-aa02-77e1b8d10082 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.039208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.039294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.039567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.039690] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('323c937c-95d9-4d25-aa02-77e1b8d10082',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.176519] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.176519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.177012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.177354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.177612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.177816] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a77a8e2-3651-49e0-b208-988a23ca643d already deleted. [ 1049.178034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a77a8e2-3651-49e0-b208-988a23ca643d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.381756] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f37877-f530-4fa7-afd7-080093e64471: rpc.has_security_group_logging(os_id): False [ 1049.400295] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.400591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.400671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.400894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.400991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.401220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.401320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.401382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.401539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.402059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.402059] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.402059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.402059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.402368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.402368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.402368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.402509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.402509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.402609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.402689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.402774] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be updated. [ 1049.487468] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.488239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.488369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.488587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.488764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.501939] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: IN_PROGRESS for 2s [ 1049.542415] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 323c937c-95d9-4d25-aa02-77e1b8d10082 with status ACTIVE [ 1049.542679] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.542817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.542887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.543407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.543407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.543407] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.543564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.543564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.543670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.543748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.543928] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.544040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.544105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.544245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.544316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.544418] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 323c937c-95d9-4d25-aa02-77e1b8d10082 is going to be updated. [ 1049.582649] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.582802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.582874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.583100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.583242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.583999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-323c937c-95d9-4d25-aa02-77e1b8d10082" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.202146] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1050.202459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.202547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.202770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.202974] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.203118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.203293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.203293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.203379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.203477] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.633139] env[70032]: INFO networking_nsxv3.common.synchronization [req-3e562ed3-4c6f-4b38-a5fc-99bde6e9537d req-f8d80752-2180-48c4-906a-e987c26c1aed tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1050.633725] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1050.634045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.634168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.634239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.634438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.634588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.634688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.634752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.634979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.637291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.637513] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.706724] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.140420] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.140700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.140700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.140884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.140974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.141185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.141282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.141333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.141798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.141798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.141798] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1051.169185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.169185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.169185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.169185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.169185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.177238] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1051.207769] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.545279] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: SUCCESS [ 1051.545279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.714545] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.714705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.714775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.715406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.715406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.715406] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1051.742033] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.742190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.742647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.742647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.742647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.751594] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1052.918040] env[70032]: INFO networking_nsxv3.common.synchronization [req-6027e286-53ba-4068-992a-f13f50106733 req-c2390178-beec-4958-85ec-8b9aad9fff97 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1052.918617] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1052.918978] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.919521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.919521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.919735] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.919914] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.920032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.920096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.920257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.920348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.920448] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.187157] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1053.187333] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a deletion is rescheduled due to dependency. [ 1053.187448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.427602] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.427602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.427602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.427602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.450473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.450473] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.450473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.450473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.450473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.450473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.450473] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1053.478714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.480825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.480825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.480825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.480825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.490799] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1053.567271] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.567631] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.567795] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.569458] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.569458] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.569458] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.569458] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.569703] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.569945] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.570184] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.570301] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.570409] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.570705] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.570847] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.570959] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.571154] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.589891] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.590107] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1053.590239] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.590454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.590813] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-33b91eac-2c1c-4a26-a243-ede46b977fdd taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.591015] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.591150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.591493] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.591636] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33b91eac-2c1c-4a26-a243-ede46b977fdd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.762602] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1053.762835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.763018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.763246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.763745] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.763745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.763745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.763884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.763920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.764013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.764120] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.765062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.765234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.765399] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.765503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.765567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.765707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.765794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.765881] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.094824] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.095227] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.095227] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.095535] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.096015] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.096015] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 33b91eac-2c1c-4a26-a243-ede46b977fdd not found, creating... [ 1054.096215] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.096406] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.096535] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.096810] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.097035] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.097358] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.097548] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.097673] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.098148] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.098573] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.098573] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 33b91eac-2c1c-4a26-a243-ede46b977fdd is going to be created. [ 1054.118701] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.118959] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.119183] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.119576] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.119803] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.120392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.271303] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.271509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.271722] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.422437] env[70032]: INFO networking_nsxv3.common.synchronization [req-aa84be0e-add2-457a-a34a-99d86fa86393 req-78ad5ec9-2b6e-40d3-ae3b-4f2cf6158606 tempest-ServersTestManualDisk-805921895 tempest-ServersTestManualDisk-805921895-project-member] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_members [ 1054.423359] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGHEST for action security_group_members [ 1054.423799] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.423799] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.423946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.424055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.424201] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.424865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.424865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.424865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.424865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.424865] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.472354] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b2d00c81-dfa3-4e0d-835a-d7feb02ddae2 None None] Enqueued Resource ID: d6385fc3-043c-48a9-af8e-27cb70aa857b with Priority: HIGHEST for action port [ 1054.474577] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6385fc3-043c-48a9-af8e-27cb70aa857b with Priority: HIGHEST for action port [ 1054.474988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6385fc3-043c-48a9-af8e-27cb70aa857b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.475160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6385fc3-043c-48a9-af8e-27cb70aa857b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.475232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6385fc3-043c-48a9-af8e-27cb70aa857b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.475624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6385fc3-043c-48a9-af8e-27cb70aa857b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.475715] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6385fc3-043c-48a9-af8e-27cb70aa857b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.778021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.848208] env[70032]: INFO networking_nsxv3.common.synchronization [req-5b614735-c829-4d74-8d22-cd61f61d5372 req-f4d044e6-fbe5-40fb-adf4-0886c6a2a39c tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1054.849804] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1054.849804] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.850077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.850225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.851039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.851039] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.851039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.851039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.851039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.851251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.851401] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.927588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.927746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.927815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.928786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.928786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.928786] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.928786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.928786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.929086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.929086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.929086] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 is going to be updated. [ 1054.959287] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.959504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.959598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.959840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.960269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.972290] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: IN_PROGRESS for 2s [ 1054.977964] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6385fc3-043c-48a9-af8e-27cb70aa857b [ 1054.978545] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.978837] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.978974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.979261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.979408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.979482] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6385fc3-043c-48a9-af8e-27cb70aa857b already deleted. [ 1054.979589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6385fc3-043c-48a9-af8e-27cb70aa857b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.280559] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.280966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.280966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.281091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.281191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.281296] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1055.340224] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.340970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.342085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.342357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.342512] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.358372] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.358372] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.358372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.358372] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1055.365517] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1055.395021] env[70032]: INFO networking_nsxv3.common.synchronization [req-6027e286-53ba-4068-992a-f13f50106733 req-94b827bc-461b-455d-975b-1fd303eeb3bf service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1055.395021] env[70032]: INFO networking_nsxv3.common.synchronization [req-6027e286-53ba-4068-992a-f13f50106733 req-94b827bc-461b-455d-975b-1fd303eeb3bf service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1055.395021] env[70032]: INFO networking_nsxv3.common.synchronization [req-6027e286-53ba-4068-992a-f13f50106733 req-94b827bc-461b-455d-975b-1fd303eeb3bf service nova] Enqueued Resource ID: 33b91eac-2c1c-4a26-a243-ede46b977fdd with Priority: HIGHEST for action port [ 1055.395021] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1055.395021] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1055.395021] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33b91eac-2c1c-4a26-a243-ede46b977fdd with Priority: HIGHEST for action port [ 1055.395646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.395646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.395646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.395778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.395808] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.397528] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.397635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.397948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-33b91eac-2c1c-4a26-a243-ede46b977fdd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.398641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.399214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.399521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.399636] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33b91eac-2c1c-4a26-a243-ede46b977fdd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.402786] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.402786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.402786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.402786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.402786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.421819] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1055.502874] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1055.503126] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 deletion is rescheduled due to dependency. [ 1055.503268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.503482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.503733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.503966] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.504147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.504222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.504404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.504528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.504650] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.903765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.903765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.909407] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33b91eac-2c1c-4a26-a243-ede46b977fdd with status ACTIVE [ 1055.909880] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.909880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.910089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.910143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.910237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.910428] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.910531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.910585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.910732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.910807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.910987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.911095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.911160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.911298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.911373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.911457] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33b91eac-2c1c-4a26-a243-ede46b977fdd is going to be updated. [ 1055.933334] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.933496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.933496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.933712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.933848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.934022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33b91eac-2c1c-4a26-a243-ede46b977fdd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.007658] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.510294] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.569141] env[70032]: INFO networking_nsxv3.common.synchronization [None req-4c69ba8b-3203-4996-99ff-6dd63e26c242 None None] Enqueued Resource ID: 0918254f-4ec7-460a-abe5-4708d13c00e0 with Priority: HIGHEST for action port [ 1056.569141] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0918254f-4ec7-460a-abe5-4708d13c00e0 with Priority: HIGHEST for action port [ 1056.569141] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-0918254f-4ec7-460a-abe5-4708d13c00e0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.569141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0918254f-4ec7-460a-abe5-4708d13c00e0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.569141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0918254f-4ec7-460a-abe5-4708d13c00e0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.569465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0918254f-4ec7-460a-abe5-4708d13c00e0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.569676] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0918254f-4ec7-460a-abe5-4708d13c00e0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.980539] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14c7722e-02ea-467c-af4c-394e1f839b23 in Status: SUCCESS [ 1056.980739] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 deletion is rescheduled due to dependency. [ 1056.980858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.015288] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.015288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.015288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.015288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.015288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.015288] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1057.045988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.046216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.046304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.046569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.046718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.056485] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1057.071970] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0918254f-4ec7-460a-abe5-4708d13c00e0 [ 1057.072539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.072708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.072798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.073017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.073124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.073244] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0918254f-4ec7-460a-abe5-4708d13c00e0 already deleted. [ 1057.073352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0918254f-4ec7-460a-abe5-4708d13c00e0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.373647] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1057.374046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.374232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.374456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.374669] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.374762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.374824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.375100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.375273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.375330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.375511] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.375599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.375699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.375821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.375972] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.376093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.376192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.376415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.376461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.376512] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.376639] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.436177] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1057.436449] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 1057.436582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.879480] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26164ff-f3d0-4ac4-97ed-86984dd723e3: rpc.has_security_group_logging(os_id): False [ 1057.902121] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.902355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.902435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.902651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.902747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.902948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.903042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.903108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.903258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.903340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.903596] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.903701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.903763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.903906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.903983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.904199] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.904295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.904356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.904511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.904574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.904664] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1057.976892] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.977189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.977277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.977608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.977849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.992316] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1058.904060] env[70032]: INFO networking_nsxv3.common.synchronization [req-238af1f5-544d-46e8-aa55-f9f7ca17dde2 req-f3948aa4-e28e-4d41-b7ea-6f817782d4cb tempest-ServersWithSpecificFlavorTestJSON-1841008358 tempest-ServersWithSpecificFlavorTestJSON-1841008358-project-member] Enqueued Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 1058.904060] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef with Priority: HIGHEST for action security_group_members [ 1058.906570] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0f9ea3-e335-4804-8789-09a66f5ffeef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.906570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.906570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.906570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.906570] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.906570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.906570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.906570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.907071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.907071] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0f9ea3-e335-4804-8789-09a66f5ffeef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.069323] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1059.069498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.070040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.070264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.070458] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.070574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.070641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.070790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.070872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.070955] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.071061] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.413545] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.413727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.413795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.414073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.435353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.436488] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.436882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.437245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.438875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.438993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.439130] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef is going to be updated. [ 1059.470286] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.470447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.470539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.470866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.471404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.484384] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: IN_PROGRESS for 2s [ 1059.577048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.577048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.577048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.577048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.577048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.578646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.578646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.578646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.578646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.578646] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.007093] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1060.007093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.007093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.007093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.007093] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.084296] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d880077d-b1e8-47fa-bc09-7da9308456b0: rpc.has_security_group_logging(os_id): False [ 1060.102671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.102819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.102900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.103162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.103259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.103461] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.103558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.103619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.104888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.104888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.104888] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.106574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.106574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.106574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.106574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.106574] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.106574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.108106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.108106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.108106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.108106] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1060.178187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.178406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.178454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.178656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.178870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.224725] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1060.509539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.509646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.509697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.509914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.510106] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.510212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.510395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.510463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.510515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.510600] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.510689] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.689889] env[70032]: INFO networking_nsxv3.common.synchronization [None req-cfaa5d03-3d61-47c0-9087-3647a8485e5f tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1060.690428] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1060.690898] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.690972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.691967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.692222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.692391] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.692504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.692566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.692732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.692815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.692907] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.015685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.015685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.015685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.016023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.016783] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.016783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.016783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.016783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.016783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.017129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.017129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.017211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.017211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.018979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.019178] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.019301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.019372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.019526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.019611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.019698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.019794] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.195093] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.499022] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef in Status: SUCCESS [ 1061.499022] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0f9ea3-e335-4804-8789-09a66f5ffeef deletion is rescheduled due to dependency. [ 1061.499128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0f9ea3-e335-4804-8789-09a66f5ffeef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.521971] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c26164ff-f3d0-4ac4-97ed-86984dd723e3: rpc.has_security_group_logging(os_id): False [ 1061.541023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.541184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.541240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.541571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.541571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.541746] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.542026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.542026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.542026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.542171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.542355] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.542355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.542457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.542559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.542636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.542833] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.542929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.543010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.544368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.544463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.544561] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1061.618637] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.618893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.618893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.619077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.619204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.636804] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1061.699747] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.204983] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.204983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.205882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.207538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.207662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.207788] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1062.217599] env[70032]: INFO networking_nsxv3.common.synchronization [req-ea281280-395f-4f3a-9c44-492b8486cb28 req-2905046b-8050-42f3-9ec6-1fcc51922095 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1062.218255] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1062.218714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.218802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.218889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.221923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.222177] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.222318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.222443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.222641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.222842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.222842] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.236981] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.237159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.237278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.240021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.240021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.241298] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1062.241518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.255259] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1062.567129] env[70032]: INFO networking_nsxv3.common.synchronization [req-ea281280-395f-4f3a-9c44-492b8486cb28 req-6ab53adb-6481-48b7-a397-9deca8d5b9a3 tempest-ServersTestMultiNic-727336322 tempest-ServersTestMultiNic-727336322-project-member] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1062.567129] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGHEST for action security_group_members [ 1062.567129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.567754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.725511] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.172756] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.176400] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.176648] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.176955] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.177303] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.177590] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.177898] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.178074] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.178261] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.178479] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.178726] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.178800] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.178900] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.179064] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.179139] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.179283] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.204564] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.207162] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.207162] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.207162] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.207162] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-103ed2b5-2960-4d5b-9f11-c3cced5af087 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.207162] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.207162] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.207162] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.207162] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103ed2b5-2960-4d5b-9f11-c3cced5af087',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.228730] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.650481] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1063.650795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.711009] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.711511] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.711703] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.712055] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.712238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.712798] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 103ed2b5-2960-4d5b-9f11-c3cced5af087 not found, creating... [ 1063.713156] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.713375] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.713534] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.713805] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.713990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.714506] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.714688] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.714810] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.715044] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.715195] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.715339] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 103ed2b5-2960-4d5b-9f11-c3cced5af087 is going to be created. [ 1063.736262] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.736262] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.736262] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.736607] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.736935] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.737142] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.738009] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.738157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.738249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.738435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.738524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.738616] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1063.769387] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.770483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.770730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.770924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.771350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.785024] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1064.271175] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1064.271175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.957380] env[70032]: INFO networking_nsxv3.common.synchronization [None req-204148e9-06b1-4643-b1e7-39dbd0c4c790 None None] Enqueued Resource ID: af4dec9a-6f03-4612-b9d7-18b2096fd3a6 with Priority: HIGHEST for action port [ 1064.958017] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af4dec9a-6f03-4612-b9d7-18b2096fd3a6 with Priority: HIGHEST for action port [ 1064.962604] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-af4dec9a-6f03-4612-b9d7-18b2096fd3a6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.966215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af4dec9a-6f03-4612-b9d7-18b2096fd3a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.966215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af4dec9a-6f03-4612-b9d7-18b2096fd3a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.966215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af4dec9a-6f03-4612-b9d7-18b2096fd3a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.966215] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af4dec9a-6f03-4612-b9d7-18b2096fd3a6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.094514] env[70032]: INFO networking_nsxv3.common.synchronization [req-aeefc829-1ed4-4a46-9bd3-8bd71563c7e7 req-fb25d00b-e76b-477c-82e3-7b679a2b00e1 service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1065.094591] env[70032]: INFO networking_nsxv3.common.synchronization [req-aeefc829-1ed4-4a46-9bd3-8bd71563c7e7 req-fb25d00b-e76b-477c-82e3-7b679a2b00e1 service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1065.094781] env[70032]: INFO networking_nsxv3.common.synchronization [req-aeefc829-1ed4-4a46-9bd3-8bd71563c7e7 req-fb25d00b-e76b-477c-82e3-7b679a2b00e1 service nova] Enqueued Resource ID: 103ed2b5-2960-4d5b-9f11-c3cced5af087 with Priority: HIGHEST for action port [ 1065.096463] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1065.097342] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1065.097342] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103ed2b5-2960-4d5b-9f11-c3cced5af087 with Priority: HIGHEST for action port [ 1065.097342] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.097659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.097659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.097775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.097822] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.099245] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.099443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.099524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.099720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.099876] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.099998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.101544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.101744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.101863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.101981] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.102941] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-103ed2b5-2960-4d5b-9f11-c3cced5af087 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.103095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.103166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.103352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.103454] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103ed2b5-2960-4d5b-9f11-c3cced5af087',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.469467] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af4dec9a-6f03-4612-b9d7-18b2096fd3a6 [ 1065.469467] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.469467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.469467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.470519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.470519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.470519] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af4dec9a-6f03-4612-b9d7-18b2096fd3a6 already deleted. [ 1065.470519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af4dec9a-6f03-4612-b9d7-18b2096fd3a6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.606036] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.607082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.607254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.609230] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 103ed2b5-2960-4d5b-9f11-c3cced5af087 with status ACTIVE [ 1065.609230] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.609230] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.609230] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.609230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.612407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.612407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.612407] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 103ed2b5-2960-4d5b-9f11-c3cced5af087 is going to be updated. [ 1065.639814] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.639900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.639937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.640213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.640372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.640555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-103ed2b5-2960-4d5b-9f11-c3cced5af087" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.793989] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1065.794201] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.794473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.794782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.795048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.795148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.795203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.795425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.795660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.796346] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.115407] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.145779] env[70032]: INFO networking_nsxv3.common.synchronization [req-2be4c776-f52d-4a63-a0b6-bbed3b98c43c req-5640aaea-1e1e-4e42-922d-a62e6630512d tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1066.147708] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1066.148303] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.148533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.148611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.149158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.149158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.149374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.149374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.149710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.150056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.150162] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.301268] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.301479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.301565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.301852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.301965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.302229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.302371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.302438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.302642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.302748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.302856] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be updated. [ 1066.332444] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.332616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.332660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.333659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.333659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.342614] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: IN_PROGRESS for 2s [ 1066.408054] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ac96669d-e5c5-4517-ae5b-e001a1a257ab None None] Enqueued Resource ID: 3db8751e-d6d6-4803-8ad5-9cbaef30ed0c with Priority: HIGHEST for action port [ 1066.408678] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db8751e-d6d6-4803-8ad5-9cbaef30ed0c with Priority: HIGHEST for action port [ 1066.409066] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3db8751e-d6d6-4803-8ad5-9cbaef30ed0c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.409453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3db8751e-d6d6-4803-8ad5-9cbaef30ed0c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.409578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3db8751e-d6d6-4803-8ad5-9cbaef30ed0c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.410046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3db8751e-d6d6-4803-8ad5-9cbaef30ed0c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.410192] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3db8751e-d6d6-4803-8ad5-9cbaef30ed0c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.616604] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.616958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.616958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.617734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.617734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.617891] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1066.645903] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.646274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.646357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.646577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.646736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.653037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.653299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.653438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.653703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.653858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.654172] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.654347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.654480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.654736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.654893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.655042] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1066.657742] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1066.685384] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.685590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.685672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.685917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.686090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.697533] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1066.913474] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3db8751e-d6d6-4803-8ad5-9cbaef30ed0c [ 1066.914209] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.914419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.914480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.914682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.914788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.914892] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3db8751e-d6d6-4803-8ad5-9cbaef30ed0c already deleted. [ 1066.914971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3db8751e-d6d6-4803-8ad5-9cbaef30ed0c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.983952] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.983952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.983952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.983952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.984862] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.985306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.985593] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.985976] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.986290] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.986684] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.987186] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.987444] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.987686] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.989018] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.989018] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.989018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.006212] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.006899] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1067.009018] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.009018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-343" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.009018] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.009018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.009018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.009018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.009018] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a12fce8-cd61-4ac5-a048-4562dbbd4bef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.512460] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.512729] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.512891] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.513200] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.513415] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.513597] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 1a12fce8-cd61-4ac5-a048-4562dbbd4bef not found, creating... [ 1067.513892] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.514069] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.514214] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.514487] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.514636] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.514954] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.515161] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.515304] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.515535] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.515675] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.515846] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 1a12fce8-cd61-4ac5-a048-4562dbbd4bef is going to be created. [ 1067.536436] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.536830] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.537151] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.537507] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.537871] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.538159] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.756924] env[70032]: INFO networking_nsxv3.common.synchronization [None req-a6c7f46e-5491-4ea7-9f07-8eff6bf8bf56 None None] Enqueued Resource ID: f95b9121-5bde-4077-8740-0e4e31ed32f2 with Priority: HIGHEST for action port [ 1067.758176] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f95b9121-5bde-4077-8740-0e4e31ed32f2 with Priority: HIGHEST for action port [ 1067.759116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f95b9121-5bde-4077-8740-0e4e31ed32f2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.759116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f95b9121-5bde-4077-8740-0e4e31ed32f2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.759116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f95b9121-5bde-4077-8740-0e4e31ed32f2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.760391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f95b9121-5bde-4077-8740-0e4e31ed32f2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.760391] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95b9121-5bde-4077-8740-0e4e31ed32f2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.148437] env[70032]: INFO networking_nsxv3.common.synchronization [req-8972f836-c49f-4c7c-b493-9a8b3500e27b req-a7ba2368-18d3-4607-8ee1-04b0b67314d7 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_members [ 1068.149126] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGHEST for action security_group_members [ 1068.149741] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.149741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.149741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.149741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.149991] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.149991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.149991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.150637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.150637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.150637] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.262137] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f95b9121-5bde-4077-8740-0e4e31ed32f2 [ 1068.262462] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.262615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.262685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.262896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.262982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.263099] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f95b9121-5bde-4077-8740-0e4e31ed32f2 already deleted. [ 1068.264228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f95b9121-5bde-4077-8740-0e4e31ed32f2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.358927] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 in Status: SUCCESS [ 1068.359069] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 deletion is rescheduled due to dependency. [ 1068.359236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.361755] env[70032]: INFO networking_nsxv3.common.synchronization [req-2be4c776-f52d-4a63-a0b6-bbed3b98c43c req-c6869ede-db53-49ca-a69b-e8f74e071cf5 service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 1068.362358] env[70032]: INFO networking_nsxv3.common.synchronization [req-2be4c776-f52d-4a63-a0b6-bbed3b98c43c req-c6869ede-db53-49ca-a69b-e8f74e071cf5 service nova] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1068.362632] env[70032]: INFO networking_nsxv3.common.synchronization [req-2be4c776-f52d-4a63-a0b6-bbed3b98c43c req-c6869ede-db53-49ca-a69b-e8f74e071cf5 service nova] Enqueued Resource ID: 1a12fce8-cd61-4ac5-a048-4562dbbd4bef with Priority: HIGHEST for action port [ 1068.364370] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_rules [ 1068.364370] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1068.364370] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a12fce8-cd61-4ac5-a048-4562dbbd4bef with Priority: HIGHEST for action port [ 1068.364370] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.364370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.364720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.365287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.366244] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.367283] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.367382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.367674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.367674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.367819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.367916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.368507] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a12fce8-cd61-4ac5-a048-4562dbbd4bef',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.656209] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.656844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.656969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.657231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.657334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.658495] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.658495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.658495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.658495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.658495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.658495] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 is going to be updated. [ 1068.668389] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1068.668736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.668911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.669130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.669320] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.669434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.669506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.669660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.669739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.669823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.669914] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.688312] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.692049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.692049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.692049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.692049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.701956] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0133496a-f61f-45f7-a024-b9b137774b66 in Status: IN_PROGRESS for 2s [ 1068.706956] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1068.707352] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a deletion is rescheduled due to dependency. [ 1068.708515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.708515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.708515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.708515] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.708515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.708515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.708804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.708804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.709986] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.870032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.870353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.871888] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a12fce8-cd61-4ac5-a048-4562dbbd4bef with status ACTIVE [ 1068.872160] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.872297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.872366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.872571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.872662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.872833] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.872929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.872991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.873183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.873297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.873508] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.873634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.873716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.873888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.873987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.874387] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a12fce8-cd61-4ac5-a048-4562dbbd4bef is going to be updated. [ 1068.904773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.905220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.905310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.905523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.905680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.905832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a12fce8-cd61-4ac5-a048-4562dbbd4bef" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.174161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.174161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.174161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.174161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.174161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.174161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.174161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.174652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.174652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.174652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.174652] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.174874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.174874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.174948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.175124] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.175240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.175282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.175856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.175856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.175856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.175856] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.213776] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.681500] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d880077d-b1e8-47fa-bc09-7da9308456b0: rpc.has_security_group_logging(os_id): False [ 1069.698206] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.698340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.698340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.698592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.698932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.699017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.699114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.699204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.700069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.700115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.700624] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.700624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.700624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.700764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.700764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.700902] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.701015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.701084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.701231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.701306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.701496] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1069.717536] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.725452] env[70032]: INFO networking_nsxv3.common.synchronization [None req-14aafdce-2535-460e-90ed-6260abc515db tempest-ServersV294TestFqdnHostnames-1130357765 tempest-ServersV294TestFqdnHostnames-1130357765-project-member] Enqueued Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_rules [ 1069.726135] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_rules [ 1069.726648] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.728447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.728447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.728447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.728447] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.762150] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.763080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.763080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.763309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.763480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.779256] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1069.857084] env[70032]: INFO networking_nsxv3.common.synchronization [None req-cdca8bfd-ae26-4c6b-9b77-d989b3f23f13 tempest-ServersV294TestFqdnHostnames-1130357765 tempest-ServersV294TestFqdnHostnames-1130357765-project-member] Enqueued Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_rules [ 1069.857655] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_rules [ 1069.857987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.858084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.964899] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f20ee153-ad9d-4925-83b8-92a2702fa8b0 None None] Enqueued Resource ID: 5ffe30dd-632b-4106-a3bb-66b71a60ce0d with Priority: HIGHEST for action port [ 1069.964899] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ffe30dd-632b-4106-a3bb-66b71a60ce0d with Priority: HIGHEST for action port [ 1069.964899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ffe30dd-632b-4106-a3bb-66b71a60ce0d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.964899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ffe30dd-632b-4106-a3bb-66b71a60ce0d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.964899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ffe30dd-632b-4106-a3bb-66b71a60ce0d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.964899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ffe30dd-632b-4106-a3bb-66b71a60ce0d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.964899] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ffe30dd-632b-4106-a3bb-66b71a60ce0d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.008575] env[70032]: INFO networking_nsxv3.common.synchronization [None req-23fe9cb5-27d6-41b5-a5f4-316b6e4ddedc None None] Enqueued Resource ID: e7970d11-c362-4296-abe4-2b00081fdda9 with Priority: HIGHEST for action port [ 1070.009200] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7970d11-c362-4296-abe4-2b00081fdda9 with Priority: HIGHEST for action port [ 1070.010987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7970d11-c362-4296-abe4-2b00081fdda9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.010987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7970d11-c362-4296-abe4-2b00081fdda9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.010987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7970d11-c362-4296-abe4-2b00081fdda9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.010987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7970d11-c362-4296-abe4-2b00081fdda9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.010987] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7970d11-c362-4296-abe4-2b00081fdda9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.225121] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.225337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.225415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.225633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.225745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.225827] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1070.253853] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.253853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.253853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.253853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.253853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.253853] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae already deleted. [ 1070.253853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.253853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.253853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.253853] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.266311] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.266459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.266534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.266751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.266900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.276993] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1070.469860] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ffe30dd-632b-4106-a3bb-66b71a60ce0d [ 1070.469860] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.469860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.469860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.469860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.469860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.469860] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ffe30dd-632b-4106-a3bb-66b71a60ce0d already deleted. [ 1070.469860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ffe30dd-632b-4106-a3bb-66b71a60ce0d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.515700] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7970d11-c362-4296-abe4-2b00081fdda9 [ 1070.517633] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.517633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.517633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.517633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.517633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.517633] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7970d11-c362-4296-abe4-2b00081fdda9 already deleted. [ 1070.517633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7970d11-c362-4296-abe4-2b00081fdda9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.715310] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0133496a-f61f-45f7-a024-b9b137774b66 in Status: SUCCESS [ 1070.715541] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 deletion is rescheduled due to dependency. [ 1070.715690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.775735] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.776342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.776342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.776342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.776342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.776516] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae already deleted. [ 1070.776516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.784087] env[70032]: INFO networking_nsxv3.common.synchronization [None req-e00bd69d-02ab-471e-af8f-79dd29f7284a tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_rules [ 1071.784719] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_rules [ 1071.786598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.786598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.786598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.786926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.786926] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.796754] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1071.796968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.917243] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c938495a-4fce-4a7c-ad7b-4749c2ef30a2 tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_rules [ 1071.917243] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_rules [ 1071.917243] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.917243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.289098] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1072.289343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.291480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.291480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.291480] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.291480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.291480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.291480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.291480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.291480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.291480] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.309101] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.309553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.309553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.309553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.309707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.309707] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 already deleted. [ 1072.309776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.310493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.310493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.310493] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.406658] env[70032]: INFO networking_nsxv3.common.synchronization [None req-a9ea30ee-d3bb-4795-9948-f3f6e7d4aab0 None None] Enqueued Resource ID: 4b64512f-1357-44f8-96c7-41da90314cb2 with Priority: HIGHEST for action port [ 1072.406837] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b64512f-1357-44f8-96c7-41da90314cb2 with Priority: HIGHEST for action port [ 1072.407589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b64512f-1357-44f8-96c7-41da90314cb2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.407589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b64512f-1357-44f8-96c7-41da90314cb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.407766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b64512f-1357-44f8-96c7-41da90314cb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.408120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b64512f-1357-44f8-96c7-41da90314cb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.408120] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b64512f-1357-44f8-96c7-41da90314cb2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.794161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.794161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.794161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.795180] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.795180] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.795180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.795539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.795539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.795539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.795539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.795674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.796053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.796053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.796053] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.833646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.833646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.833646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.833646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.833646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.833646] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 already deleted. [ 1072.833646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.911618] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b64512f-1357-44f8-96c7-41da90314cb2 [ 1072.911618] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.911618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.911618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.911618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.911618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.911618] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b64512f-1357-44f8-96c7-41da90314cb2 already deleted. [ 1072.911618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b64512f-1357-44f8-96c7-41da90314cb2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.301037] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1d61d13-44e5-4c83-936b-8a6c378d760a: rpc.has_security_group_logging(os_id): False [ 1073.319066] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.319230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.319325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.320135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.320135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.320135] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.320135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.320135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.320135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.320410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.320410] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.321104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.321218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.321377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.321482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.321671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.321758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.321827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.322464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.322464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.322464] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1073.382668] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.382814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.382814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.384805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.384805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.396658] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1074.530299] env[70032]: INFO networking_nsxv3.common.synchronization [req-2ea935a0-ccf1-431d-85f1-52c10d25779f req-191437d5-154c-4f1d-bfde-2df7176bc3ab tempest-VolumesAdminNegativeTest-1559699096 tempest-VolumesAdminNegativeTest-1559699096-project-member] Enqueued Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_members [ 1074.531407] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_members [ 1074.531407] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab8694e-7329-47c5-b4fe-30318bb49368 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.531407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.531407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.531745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.531745] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.531851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.531904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.533104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.534473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.534473] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.037190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.037190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.037190] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 already deleted. [ 1075.037190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.361738] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.362151] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.362423] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.363359] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.363359] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.363359] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.363661] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.363731] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.363869] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.364129] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.364241] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.364318] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.364638] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.364638] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.364638] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.364909] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.397538] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.397538] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.397708] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.397874] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-922" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.398596] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-62360db3-f2f7-429a-8a70-68fad2bfe667 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.398596] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.398596] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.398807] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.398925] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62360db3-f2f7-429a-8a70-68fad2bfe667',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.421922] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1075.421922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.904743] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.905045] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.905213] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.905505] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.905658] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.905816] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 62360db3-f2f7-429a-8a70-68fad2bfe667 not found, creating... [ 1075.906091] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.906432] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.906432] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.906594] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.906730] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.907018] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.907176] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.907472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.907720] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.908164] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.908164] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 62360db3-f2f7-429a-8a70-68fad2bfe667 is going to be created. [ 1075.926817] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.927144] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.927414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.927826] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.928143] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.928429] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.898618] env[70032]: INFO networking_nsxv3.common.synchronization [req-cb61f13c-25e5-469b-8f7a-850326957820 req-3bdeb595-ad40-42ad-b7b6-fce366cc34c0 tempest-ServerRescueTestJSON-709973283 tempest-ServerRescueTestJSON-709973283-project-member] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1076.899231] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1076.899546] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.899693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.899772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.900247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.900409] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.900516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.900617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.900742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.900827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.900923] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.210256] env[70032]: INFO networking_nsxv3.common.synchronization [req-2ea935a0-ccf1-431d-85f1-52c10d25779f req-ff145442-d713-4363-aa59-9f2881226051 service nova] Enqueued Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_rules [ 1077.210256] env[70032]: INFO networking_nsxv3.common.synchronization [req-2ea935a0-ccf1-431d-85f1-52c10d25779f req-ff145442-d713-4363-aa59-9f2881226051 service nova] Enqueued Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_members [ 1077.210693] env[70032]: INFO networking_nsxv3.common.synchronization [req-2ea935a0-ccf1-431d-85f1-52c10d25779f req-ff145442-d713-4363-aa59-9f2881226051 service nova] Enqueued Resource ID: 62360db3-f2f7-429a-8a70-68fad2bfe667 with Priority: HIGHEST for action port [ 1077.214030] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_rules [ 1077.214030] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_members [ 1077.214030] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62360db3-f2f7-429a-8a70-68fad2bfe667 with Priority: HIGHEST for action port [ 1077.214030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab8694e-7329-47c5-b4fe-30318bb49368 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.214030] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.214030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab8694e-7329-47c5-b4fe-30318bb49368 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.214030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.214030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.214030] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.215612] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-62360db3-f2f7-429a-8a70-68fad2bfe667 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.215612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.215612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.215612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.215870] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62360db3-f2f7-429a-8a70-68fad2bfe667',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.263243] env[70032]: INFO networking_nsxv3.common.synchronization [req-899c9271-4a00-4bf2-9eb3-ad5624483aee req-44eef5af-d87e-4c86-b022-2d3d05ebd01d tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1077.263697] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1077.265037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.265037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.265037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.265037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.265037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.265037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.265037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.265412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.265412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.265479] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.345055] env[70032]: INFO networking_nsxv3.common.synchronization [req-fd90a7c6-1123-4e5a-8f59-34846bd905ab req-fa55d9e2-03a9-4716-b73d-a450b89a4930 tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1077.345786] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1077.346107] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.346241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.346332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.346496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.346639] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.346732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.346854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.346969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.347067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.347154] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.402825] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.435907] env[70032]: INFO networking_nsxv3.common.synchronization [req-23379f87-b738-4456-b3a8-9486d617a187 req-8ef5d451-6ef3-40c2-9035-e67be0cff50c tempest-ServerActionsV293TestJSON-1016486754 tempest-ServerActionsV293TestJSON-1016486754-project-member] Enqueued Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_members [ 1077.436380] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGHEST for action security_group_members [ 1077.436974] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.437173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.437243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.437474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.437905] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.438125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.438224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.438466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.438581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.438730] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.719609] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab8694e-7329-47c5-b4fe-30318bb49368 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.719609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.719609] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.721987] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62360db3-f2f7-429a-8a70-68fad2bfe667 with status ACTIVE [ 1077.721987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.721987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.721987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.722687] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.722794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.722860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.723020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.723100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.723186] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62360db3-f2f7-429a-8a70-68fad2bfe667 is going to be updated. [ 1077.746899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.747050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.747120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.747354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.747503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.747663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62360db3-f2f7-429a-8a70-68fad2bfe667" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.773687] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.773687] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.773687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.773687] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1077.807638] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.807950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.807950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.808149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.808223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.821018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1077.849473] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.913120] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.913120] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.913120] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.913120] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.913120] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.913120] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.913120] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.913120] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.914081] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.914386] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.914708] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.914929] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.915151] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.915392] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.915610] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.915815] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.916056] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.938866] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.938866] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.938866] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.938866] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.938866] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.938866] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.938866] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.938866] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.938866] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.940560] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.940833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.940995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.941419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.941655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.941933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.942206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.942430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.942910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.944051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.944051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c991b17e-e013-4122-96ca-aa291400f826 is going to be updated. [ 1077.980032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.980032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.980032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.980032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.980032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.992021] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c991b17e-e013-4122-96ca-aa291400f826 in Status: IN_PROGRESS for 2s [ 1078.221847] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.353232] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.420291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.420291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.420291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.420291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.420291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.420291] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be updated. [ 1078.447822] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.448071] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.448225] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.448883] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.448883] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.448883] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d not found, creating... [ 1078.449171] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.449235] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.450472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.450472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.450472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.450472] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.450472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.450472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.450472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.450968] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.450968] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d is going to be created. [ 1078.452805] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.452950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.453056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.453143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.453933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.469192] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: IN_PROGRESS for 2s [ 1078.478531] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.478531] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.478531] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.478531] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.478782] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.479070] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.578704] env[70032]: INFO networking_nsxv3.common.synchronization [None req-485ff40e-7776-4793-901d-3ff55ee967c4 None None] Enqueued Resource ID: 3314a6b0-5bd4-4ddc-a119-e5644dfb64d7 with Priority: HIGHEST for action port [ 1078.579250] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3314a6b0-5bd4-4ddc-a119-e5644dfb64d7 with Priority: HIGHEST for action port [ 1078.579548] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3314a6b0-5bd4-4ddc-a119-e5644dfb64d7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.579696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3314a6b0-5bd4-4ddc-a119-e5644dfb64d7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.579764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3314a6b0-5bd4-4ddc-a119-e5644dfb64d7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.580020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3314a6b0-5bd4-4ddc-a119-e5644dfb64d7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.582423] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3314a6b0-5bd4-4ddc-a119-e5644dfb64d7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.725714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.725714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.725915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.726540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.726540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.726540] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 is going to be created. [ 1078.753443] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.753443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.753607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.753690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.753847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.767180] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 in Status: UNINITIALIZED for 2s [ 1078.858462] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.858610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.858713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.858906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.858993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.859233] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 1078.888392] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.888560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.888632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.888866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.889026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.899537] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 1079.085134] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3314a6b0-5bd4-4ddc-a119-e5644dfb64d7 [ 1079.085134] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.085134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.085134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.085134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.085134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.085391] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3314a6b0-5bd4-4ddc-a119-e5644dfb64d7 already deleted. [ 1079.085956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3314a6b0-5bd4-4ddc-a119-e5644dfb64d7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.411150] env[70032]: INFO networking_nsxv3.common.synchronization [req-899c9271-4a00-4bf2-9eb3-ad5624483aee req-dde298d5-7253-4c32-8a86-eec96d83cd7d service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 1079.411455] env[70032]: INFO networking_nsxv3.common.synchronization [req-899c9271-4a00-4bf2-9eb3-ad5624483aee req-dde298d5-7253-4c32-8a86-eec96d83cd7d service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1079.411501] env[70032]: INFO networking_nsxv3.common.synchronization [req-899c9271-4a00-4bf2-9eb3-ad5624483aee req-dde298d5-7253-4c32-8a86-eec96d83cd7d service nova] Enqueued Resource ID: fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d with Priority: HIGHEST for action port [ 1079.412065] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 1079.412208] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1079.412323] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d with Priority: HIGHEST for action port [ 1079.412649] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.412805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.412880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.413100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.413219] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.414822] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.414925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.418846] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.418846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.418846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.418846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.418846] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.831851] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1079.831951] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 1079.831998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.832173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.832388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.832577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.832800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.832800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.832900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.832973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.833078] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.916404] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.916628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.920465] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d with status ACTIVE [ 1079.920690] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.920881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.920952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.921649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.921765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.921951] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.922071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.922136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.922305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.922384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.922569] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.922662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.922724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.922863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.922938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.923031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d is going to be updated. [ 1079.949184] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.949184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.949184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.949184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.949184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.949184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe5c3d4a-ae4a-4d3a-8c3c-2ee2bc54c98d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.997920] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c991b17e-e013-4122-96ca-aa291400f826 in Status: SUCCESS [ 1079.998142] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c991b17e-e013-4122-96ca-aa291400f826 deletion is rescheduled due to dependency. [ 1079.998276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.341980] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.487076] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: SUCCESS [ 1080.487076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.777056] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 in Status: SUCCESS [ 1080.777291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.777759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.777759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.777916] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.777975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.778042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.778608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.778608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.778608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.778608] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.845525] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.908533] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1080.908754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.285387] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab8694e-7329-47c5-b4fe-30318bb49368 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.285387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.285387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.285678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.286211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.286507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.287274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.287555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.287678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.287805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.287998] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab8694e-7329-47c5-b4fe-30318bb49368 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.288301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.288301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.288388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.288612] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.288689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.288760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.288906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.289395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.289912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.290049] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.349120] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.349335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.349413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.349621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.349798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.349909] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1081.392217] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.392217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.392217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.392217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.392217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.396775] env[70032]: INFO networking_nsxv3.common.synchronization [None req-5bdf332a-ee00-4b13-85ca-9726300243bd None None] Enqueued Resource ID: dd5b2c50-b248-4654-a349-6b664975f991 with Priority: HIGHEST for action port [ 1081.398312] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5b2c50-b248-4654-a349-6b664975f991 with Priority: HIGHEST for action port [ 1081.398954] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd5b2c50-b248-4654-a349-6b664975f991 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.399157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd5b2c50-b248-4654-a349-6b664975f991" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.400644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd5b2c50-b248-4654-a349-6b664975f991" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.400644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd5b2c50-b248-4654-a349-6b664975f991" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.400644] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd5b2c50-b248-4654-a349-6b664975f991',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.409030] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1081.795076] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ab8694e-7329-47c5-b4fe-30318bb49368: rpc.has_security_group_logging(os_id): False [ 1081.813592] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.813763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.813828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.814103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.814197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.814567] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.814752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.814838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.815054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.815108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.815361] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.815472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.815549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.815705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.815811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.817100] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.820960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.820960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.820960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.820960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.820960] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 is going to be created. [ 1081.892786] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.892786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.892786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.892786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.892786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.902790] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd5b2c50-b248-4654-a349-6b664975f991 [ 1081.902790] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.902790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.902790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.903310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.903479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.904561] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd5b2c50-b248-4654-a349-6b664975f991 already deleted. [ 1081.904768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd5b2c50-b248-4654-a349-6b664975f991" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.906193] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 in Status: IN_PROGRESS for 2s [ 1082.236411] env[70032]: INFO networking_nsxv3.common.synchronization [req-a5b6efb0-1d42-4171-9dbd-50eae9c4c5b7 req-67b93814-be3a-443a-9217-6765a9b53b4e tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1082.236411] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1082.237688] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.238730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.238730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.240693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.241009] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.241192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.241419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.241561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.241699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.241843] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.748217] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.251533] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.421340] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.421340] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.421340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.421340] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.521485] env[70032]: INFO networking_nsxv3.common.synchronization [None req-cdff9fca-635b-41f4-8a65-a2f1fa863878 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1083.522203] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1083.522683] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.523489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.755041] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.755284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.755425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.755689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.755842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.755955] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1083.789857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.790027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.790099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.790342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.790458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.802256] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1083.919884] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 in Status: SUCCESS [ 1083.920200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.924821] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.926639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.926760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.927095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.927396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.927602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.927770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.931315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.931413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.931520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.931720] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.932236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.932236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.932236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.932236] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.932414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.932414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.932509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.932587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.932670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.932760] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.434979] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac44685-7555-444d-b1ce-19ece671a825: rpc.has_security_group_logging(os_id): False [ 1084.459933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.459933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.459933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.459933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.461258] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.461258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.461258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.461258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.461258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.461258] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1084.535355] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.535638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.535789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.536094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.536305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.558280] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1085.813329] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1085.813728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.813774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.813978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.814203] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.814326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.814616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.814788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.814907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.815017] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.146507] env[70032]: INFO networking_nsxv3.common.synchronization [req-69801db6-70f5-4fc6-8aa7-b71bd0d3ecda req-9b33a872-bcd7-41f6-865e-04b15dd9a4f4 tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_members [ 1086.149712] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGHEST for action security_group_members [ 1086.150339] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.150339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.150460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.151561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.151561] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.151561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.151561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.151561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.151561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.151561] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.321952] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.321952] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.321952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.321952] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1086.348563] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.348563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.348563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.348563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.348563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.358372] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1086.492303] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c31162f9-3fe7-49cb-ad92-ac56bbd5f569 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_rules [ 1086.493651] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_rules [ 1086.494585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.496424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.496424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.496424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.496424] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.568794] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1086.568794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.656449] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.656449] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.656449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.656449] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 is going to be updated. [ 1086.685972] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.686302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.686302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.686461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.686612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.695350] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: IN_PROGRESS for 2s [ 1086.832339] env[70032]: INFO networking_nsxv3.common.synchronization [None req-6aea05c7-9de2-4601-9eb6-e3f7db540988 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_rules [ 1086.833082] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_rules [ 1086.833082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.833082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.015619] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.015619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.015619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.015619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.015619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.015619] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc already deleted. [ 1087.015619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.015619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.015977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.015977] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.138188] env[70032]: INFO networking_nsxv3.common.synchronization [req-183e1f4c-ed51-49be-9b74-a95986b3eaf1 req-bf657f27-2f90-46eb-8f4e-ec9865ce7725 tempest-ServerTagsTestJSON-6260335 tempest-ServerTagsTestJSON-6260335-project-member] Enqueued Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_members [ 1087.138812] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_members [ 1087.139164] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.139279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.139779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.139779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.139779] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.139969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.139969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.143790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.143790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.143790] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.152618] env[70032]: INFO networking_nsxv3.common.synchronization [req-599311ed-f09d-428c-b821-84a5792481c7 req-86bfcf47-93ad-483a-ada6-1c0ddb52e647 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_members [ 1087.153408] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d451476b-b529-46a5-ac42-f7b74140c983 with Priority: HIGHEST for action security_group_members [ 1087.153873] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d451476b-b529-46a5-ac42-f7b74140c983 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.153999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.154302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.154485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.154746] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.154848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.154914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.155073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.155156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.155310] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d451476b-b529-46a5-ac42-f7b74140c983',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.537223] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.537366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.537450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.537690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.537776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.537875] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc already deleted. [ 1087.537956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.643073] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.643073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.643073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.643813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.643813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.643813] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.643813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.643813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.644103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.644705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.644831] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 already deleted. [ 1087.644928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.657524] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.658064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.658064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.658064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.658200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.658311] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.658409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.658494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.658661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.658728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.658823] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d451476b-b529-46a5-ac42-f7b74140c983 is going to be updated. [ 1087.682396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.682571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.682648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.683485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.683485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.692749] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d451476b-b529-46a5-ac42-f7b74140c983 in Status: IN_PROGRESS for 2s [ 1087.935251] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.935712] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-976" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.935791] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-976" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.937983] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-976" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.937983] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.938157] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.938247] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.939068] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.939920] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.940155] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.940254] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.940368] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.940480] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.940616] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.943016] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.943016] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.958648] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.958876] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1087.959058] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.959295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-976" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.959665] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.959887] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.960059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.960863] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.960863] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0e5a9e-430c-41fd-9c6d-d2d8a6209695',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.369476] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1088.369700] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 deletion is rescheduled due to dependency. [ 1088.369844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.464058] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.464058] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.464237] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.464636] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.464865] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.465124] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 not found, creating... [ 1088.465535] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.469189] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.469392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.469777] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.469982] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.470442] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.470694] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.470853] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.471182] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.471407] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.471617] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 is going to be created. [ 1088.496012] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.496305] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.496447] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.496728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.496963] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.497215] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.704674] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17fd7384-1e1f-4823-baff-e68bca324f40 in Status: SUCCESS [ 1088.704944] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 deletion is rescheduled due to dependency. [ 1088.709240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.561606] env[70032]: INFO networking_nsxv3.common.synchronization [None req-dcdd82fd-589c-4ecf-9325-01efd8b82d73 None None] Enqueued Resource ID: 7053bc31-d36d-4d27-8e24-ed445cb59ccb with Priority: HIGHEST for action port [ 1089.562654] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7053bc31-d36d-4d27-8e24-ed445cb59ccb with Priority: HIGHEST for action port [ 1089.564035] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddf0f4c2-289e-495a-ae9b-9860d661b39e req-0313e297-2f8d-4e92-838d-26508082c76d tempest-ServersV294TestFqdnHostnames-1130357765 tempest-ServersV294TestFqdnHostnames-1130357765-project-member] Enqueued Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_members [ 1089.565208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7053bc31-d36d-4d27-8e24-ed445cb59ccb taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.565869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7053bc31-d36d-4d27-8e24-ed445cb59ccb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.565979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7053bc31-d36d-4d27-8e24-ed445cb59ccb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.566363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7053bc31-d36d-4d27-8e24-ed445cb59ccb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.566539] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7053bc31-d36d-4d27-8e24-ed445cb59ccb',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.570310] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_members [ 1089.571268] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.572314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.572314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.572314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.572314] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.572314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.572314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.572598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.572598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.572838] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.705101] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d451476b-b529-46a5-ac42-f7b74140c983 in Status: SUCCESS [ 1089.705316] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d451476b-b529-46a5-ac42-f7b74140c983 deletion is rescheduled due to dependency. [ 1089.705516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d451476b-b529-46a5-ac42-f7b74140c983" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.954029] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.954029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-564" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.954029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-564" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.954029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-564" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.954029] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.954029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.954029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.954029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.954029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.955497] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.955497] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.955497] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.955497] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.955497] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.955497] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.955497] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.961029] env[70032]: INFO networking_nsxv3.common.synchronization [req-183e1f4c-ed51-49be-9b74-a95986b3eaf1 req-e69fdd81-e65b-49f8-83ef-249d24ce1293 service nova] Enqueued Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_rules [ 1089.961162] env[70032]: INFO networking_nsxv3.common.synchronization [req-183e1f4c-ed51-49be-9b74-a95986b3eaf1 req-e69fdd81-e65b-49f8-83ef-249d24ce1293 service nova] Enqueued Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_members [ 1089.961308] env[70032]: INFO networking_nsxv3.common.synchronization [req-183e1f4c-ed51-49be-9b74-a95986b3eaf1 req-e69fdd81-e65b-49f8-83ef-249d24ce1293 service nova] Enqueued Resource ID: 2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 with Priority: HIGHEST for action port [ 1089.962156] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_rules [ 1089.962274] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_members [ 1089.962387] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 with Priority: HIGHEST for action port [ 1089.962650] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.962765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.962831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.963163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.963243] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.964508] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.964508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.964508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.964634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.964707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.964811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.964854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.964990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.965079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.965163] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.966208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.966323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.966633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.966633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.966633] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0e5a9e-430c-41fd-9c6d-d2d8a6209695',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.977676] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.977676] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.977800] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.977875] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-564" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.979015] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-961b92d4-24fd-496d-9007-0bb460b3f298 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.979015] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.979015] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.979203] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.979289] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961b92d4-24fd-496d-9007-0bb460b3f298',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.073383] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7053bc31-d36d-4d27-8e24-ed445cb59ccb [ 1090.073763] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.073995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.074086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.074414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.074604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.074782] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7053bc31-d36d-4d27-8e24-ed445cb59ccb already deleted. [ 1090.074938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7053bc31-d36d-4d27-8e24-ed445cb59ccb" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.075401] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.075578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.075717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.075938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.079761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.079761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.079761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.079761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.080046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.080212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.080457] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae already deleted. [ 1090.080457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.471441] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 with status ACTIVE [ 1090.471441] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.471441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.471441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.471710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.471710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.471812] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.471873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.472011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.473185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.475380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.475380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.475380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.475380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.475380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.475380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.475380] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e0e5a9e-430c-41fd-9c6d-d2d8a6209695 is going to be updated. [ 1090.475380] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.478171] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.478171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.481703] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.481867] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.481994] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.482291] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.482442] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.482605] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 961b92d4-24fd-496d-9007-0bb460b3f298 not found, creating... [ 1090.482860] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.483801] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.487018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.487018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.487018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.487018] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.487018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.487018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.487018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.487018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.487018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 961b92d4-24fd-496d-9007-0bb460b3f298 is going to be created. [ 1090.509949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.510116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.510188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.510407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.510578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.511082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e0e5a9e-430c-41fd-9c6d-d2d8a6209695" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.517041] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.517367] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.518952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.518952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.518952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.518952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.980622] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.258510] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddf0f4c2-289e-495a-ae9b-9860d661b39e req-a00afbb4-e6c6-4e11-b998-2f82c99f71ce service nova] Enqueued Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_rules [ 1091.258721] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddf0f4c2-289e-495a-ae9b-9860d661b39e req-a00afbb4-e6c6-4e11-b998-2f82c99f71ce service nova] Enqueued Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_members [ 1091.259169] env[70032]: INFO networking_nsxv3.common.synchronization [req-ddf0f4c2-289e-495a-ae9b-9860d661b39e req-a00afbb4-e6c6-4e11-b998-2f82c99f71ce service nova] Enqueued Resource ID: 961b92d4-24fd-496d-9007-0bb460b3f298 with Priority: HIGHEST for action port [ 1091.259169] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_rules [ 1091.259478] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_members [ 1091.259478] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961b92d4-24fd-496d-9007-0bb460b3f298 with Priority: HIGHEST for action port [ 1091.264111] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.264111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.264111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.264111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.264111] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.264637] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.264755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.264804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.264949] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.265105] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.265196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.265260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.265398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.265489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.265591] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.266345] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-961b92d4-24fd-496d-9007-0bb460b3f298 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.266455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.266520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.266669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.266736] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961b92d4-24fd-496d-9007-0bb460b3f298',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.532413] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.532413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.532413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.532899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.535491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.535491] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 is going to be created. [ 1091.535491] env[70032]: INFO networking_nsxv3.common.synchronization [None req-7e0a6b5a-e21e-47f8-a66b-0b36d32690e4 tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1091.535709] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1091.536509] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.536627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.536712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.536949] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.537050] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.559533] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.559533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.559533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.559533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.559533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.563111] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8e3066de-b037-4f92-b55d-5e10da000e2f tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1091.563111] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1091.563350] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.563402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.569864] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 in Status: UNINITIALIZED for 2s [ 1091.671059] env[70032]: INFO networking_nsxv3.common.synchronization [None req-0d473052-97e3-44d5-af13-1c689485ee12 None None] Enqueued Resource ID: 8cb13d7e-30dc-465e-ac0c-6b15d3e793e3 with Priority: HIGHEST for action port [ 1091.671408] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb13d7e-30dc-465e-ac0c-6b15d3e793e3 with Priority: HIGHEST for action port [ 1091.671713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cb13d7e-30dc-465e-ac0c-6b15d3e793e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.672179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cb13d7e-30dc-465e-ac0c-6b15d3e793e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.672179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cb13d7e-30dc-465e-ac0c-6b15d3e793e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.672627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cb13d7e-30dc-465e-ac0c-6b15d3e793e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.672627] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cb13d7e-30dc-465e-ac0c-6b15d3e793e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.773190] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 961b92d4-24fd-496d-9007-0bb460b3f298 with status ACTIVE [ 1091.773190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.773190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.773190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.773190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.773190] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 961b92d4-24fd-496d-9007-0bb460b3f298 is going to be updated. [ 1091.774249] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.779834] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.779834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.798503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.798503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.798503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.798503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.798503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.798503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-961b92d4-24fd-496d-9007-0bb460b3f298" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.060053] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.060395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.060395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.060866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.060866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.060866] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d already deleted. [ 1092.060866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.061247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.061247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.061247] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.102218] env[70032]: INFO networking_nsxv3.common.synchronization [req-3a294706-698b-4a63-9818-c7b90d488cb1 req-c73d10a3-fd68-40de-aa6f-1949e6598947 tempest-ImagesTestJSON-519632207 tempest-ImagesTestJSON-519632207-project-member] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1092.105840] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGHEST for action security_group_members [ 1092.107348] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.107348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.107348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.107348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.107348] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.107348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.107348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.107348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.107827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.107827] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.174097] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cb13d7e-30dc-465e-ac0c-6b15d3e793e3 [ 1092.174424] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.174617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.174721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.175128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.175128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.175328] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cb13d7e-30dc-465e-ac0c-6b15d3e793e3 already deleted. [ 1092.175328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cb13d7e-30dc-465e-ac0c-6b15d3e793e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.280753] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.580724] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.580940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.580940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.581163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.583020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.583020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d already deleted. [ 1092.583020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.610244] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.610404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.610468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.610710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.610821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.611043] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.611163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.611221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.611352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.611423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.611533] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be updated. [ 1092.635502] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.635502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.635686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.635753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.635960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.643325] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: IN_PROGRESS for 2s [ 1092.783038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.783203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.783414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.783562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.783562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.783796] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae is going to be created. [ 1092.796909] env[70032]: INFO networking_nsxv3.common.synchronization [req-13b04474-6209-48ae-81b7-81bfe6e4b32a req-c36fd647-5eaf-4121-b1db-95c31d53b1b7 tempest-VolumesAdminNegativeTest-1559699096 tempest-VolumesAdminNegativeTest-1559699096-project-member] Enqueued Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_members [ 1092.797864] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 with Priority: HIGHEST for action security_group_members [ 1092.797864] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab8694e-7329-47c5-b4fe-30318bb49368 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.797864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.798263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.798263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.798338] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.798388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.800188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.800188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.800188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.800188] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab8694e-7329-47c5-b4fe-30318bb49368',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.811402] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.811402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.811402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.811402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.811402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.819876] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae in Status: UNINITIALIZED for 2s [ 1093.302536] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.302931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.303058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.303293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.303388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.304784] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.304784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.304784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.304784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.304784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.304784] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 is going to be updated. [ 1093.330291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.330513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.330623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.330920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.331120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.346215] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 in Status: IN_PROGRESS for 2s [ 1093.543480] env[70032]: INFO networking_nsxv3.common.synchronization [req-1a15ef0f-4eeb-4fe9-b458-b8fa6f5fa0a7 req-7f3030a4-a06e-4b3c-bade-23c0bd7b8d5c tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_members [ 1093.544064] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_members [ 1093.544395] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.544537] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.544662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.545720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.545720] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.545720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.545720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.545720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.545720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.545720] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.581508] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 in Status: SUCCESS [ 1093.581873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.582117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.582393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.582642] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.582927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.583075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.583287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.583455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.583705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.583775] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.934638] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.934949] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.935250] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.935672] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.936009] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.936385] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.936518] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.936823] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.937059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.937367] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.937617] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.937768] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.937897] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.938206] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.938382] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.938650] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.956430] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.956669] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.956796] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.957131] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.957466] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-dd89d1ca-928e-4260-971e-f824cbaa5158 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.957746] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.957917] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.958352] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.958576] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd89d1ca-928e-4260-971e-f824cbaa5158',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.051202] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.053021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.053021] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 already deleted. [ 1094.053021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.085935] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.086125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.086186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.086385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.086550] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.086647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.086714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.086865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.086940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.087042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.087193] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.087285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.087338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.087475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.087653] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.087788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.087834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.087947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.088026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.088139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.088235] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.333601] env[70032]: INFO networking_nsxv3.common.synchronization [req-cdb832ce-3fd1-4c05-81f5-9d03a7284ae1 req-bb403b66-3db1-4e16-a1ce-1ce2d3a919da tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1094.334146] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1094.334468] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.334541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.334612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.334831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.335025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.335981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.336077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.337017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.337017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.337017] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.462838] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.463096] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.463233] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.463520] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.463765] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.463836] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port dd89d1ca-928e-4260-971e-f824cbaa5158 not found, creating... [ 1094.464106] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.464337] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.464389] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.464592] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.464734] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.465119] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.465209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.465303] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.465551] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.465703] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.465847] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: dd89d1ca-928e-4260-971e-f824cbaa5158 is going to be created. [ 1094.488322] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.488534] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.488637] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.488925] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.489208] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.489437] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.592306] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57ba5aef-2625-46a9-b4f6-3654836e0f13: rpc.has_security_group_logging(os_id): False [ 1094.617580] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.617820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.617820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.618082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.618191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.618394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.618492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.618590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.618755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.618832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.619030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.619136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.619195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.619469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.619469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.619588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.619679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.619731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.619863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.619932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.620029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 is going to be created. [ 1094.652897] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1d61d13-44e5-4c83-936b-8a6c378d760a in Status: SUCCESS [ 1094.653102] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a deletion is rescheduled due to dependency. [ 1094.653215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.687108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.688171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.688171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.688171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.688171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.699879] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 in Status: IN_PROGRESS for 2s [ 1094.835232] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae in Status: SUCCESS [ 1094.835524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.835697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.835926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.836152] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.836287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.836485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.836583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.836621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.836676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.836819] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.838537] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.838668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.838721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.838941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.839019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.839795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.839795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.839795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.839795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.839795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.839795] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1094.877028] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.877028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.877184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.877265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.877406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.885901] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1095.200023] env[70032]: INFO networking_nsxv3.common.synchronization [req-1a15ef0f-4eeb-4fe9-b458-b8fa6f5fa0a7 req-9fff6e74-8f7a-44a0-817f-925d2811c444 service nova] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_rules [ 1095.200023] env[70032]: INFO networking_nsxv3.common.synchronization [req-1a15ef0f-4eeb-4fe9-b458-b8fa6f5fa0a7 req-9fff6e74-8f7a-44a0-817f-925d2811c444 service nova] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_members [ 1095.200023] env[70032]: INFO networking_nsxv3.common.synchronization [req-1a15ef0f-4eeb-4fe9-b458-b8fa6f5fa0a7 req-9fff6e74-8f7a-44a0-817f-925d2811c444 service nova] Enqueued Resource ID: dd89d1ca-928e-4260-971e-f824cbaa5158 with Priority: HIGHEST for action port [ 1095.200023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_rules [ 1095.200023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_members [ 1095.200023] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd89d1ca-928e-4260-971e-f824cbaa5158 with Priority: HIGHEST for action port [ 1095.200023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.200023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.200023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.200023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.200023] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.202526] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.203100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.203100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.203100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.203257] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.203257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.203343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.203617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.203617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.203617] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.204876] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd89d1ca-928e-4260-971e-f824cbaa5158 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.205025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.205025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.205289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.205289] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd89d1ca-928e-4260-971e-f824cbaa5158',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.339495] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.354257] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 in Status: SUCCESS [ 1095.354431] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab8694e-7329-47c5-b4fe-30318bb49368 deletion is rescheduled due to dependency. [ 1095.354542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab8694e-7329-47c5-b4fe-30318bb49368" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.707633] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.708295] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.708402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.708591] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd89d1ca-928e-4260-971e-f824cbaa5158 with status ACTIVE [ 1095.709120] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.709120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.709120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.709120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.709312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.709358] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.709448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.709501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.709649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.709724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.709921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.710693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.710812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.710977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.711076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.711171] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd89d1ca-928e-4260-971e-f824cbaa5158 is going to be updated. [ 1095.730549] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.730693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.730768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.730982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.731138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.731292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd89d1ca-928e-4260-971e-f824cbaa5158" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.843185] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cc2a59a-272e-4f81-9b52-f6c080a526ae: rpc.has_security_group_logging(os_id): False [ 1095.861854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.862051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.862051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.862358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.862461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.862881] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.862881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.862881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.863070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.863187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.863223] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae is going to be created. [ 1095.944104] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.944104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.944104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.944104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.944434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.961036] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae in Status: IN_PROGRESS for 2s [ 1096.214107] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.713222] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 in Status: SUCCESS [ 1096.713445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.716086] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.716242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.716308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.716506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.717845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.717845] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 is going to be created. [ 1096.739276] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.739517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.739581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.739784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.740065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.749760] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: UNINITIALIZED for 2s [ 1096.901061] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1096.901249] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 1096.901363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.970938] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae in Status: SUCCESS [ 1097.971433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.264808] env[70032]: INFO networking_nsxv3.common.synchronization [req-ccfa3d9c-89aa-4f35-b05e-f7dc9843abc4 req-1b2496b7-04fe-4ecb-987b-576f79b3af53 tempest-ServerRescueTestJSON-709973283 tempest-ServerRescueTestJSON-709973283-project-member] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1098.265357] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGHEST for action security_group_members [ 1098.265789] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.265898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.265944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.266243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.266493] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.266702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.266798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.267190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.267620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.267620] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.763140] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: SUCCESS [ 1098.763392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.763579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.763830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.763998] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.764147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.764189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.764338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.764431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.764530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.764621] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.771125] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.771269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.771342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.771573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.771639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.771798] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.771891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.771973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.772107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.772218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.772348] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be updated. [ 1098.798320] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.799062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.799062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.799062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.799062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.806507] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: IN_PROGRESS for 2s [ 1099.268012] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.770494] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26d43c7c-82c8-4a83-8478-40e297491039: rpc.has_security_group_logging(os_id): False [ 1099.794717] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.794890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.794985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.795265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.795385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.795740] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.798297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.798297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.798297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.798297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.798297] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 is going to be created. [ 1099.855518] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.855728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.855896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.856186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.856411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.866029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: IN_PROGRESS for 2s [ 1100.443440] env[70032]: INFO networking_nsxv3.common.synchronization [req-65d8cefd-fef7-4521-a952-0e94f3a8f866 req-29746c5b-10b6-4c37-9ce0-cf1568a6aa0a tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1100.444459] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1100.444823] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.444940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.445014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.445225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.445377] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.445494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.445572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.445927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.445927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.445927] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.817049] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f37877-f530-4fa7-afd7-080093e64471 in Status: SUCCESS [ 1100.817238] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f37877-f530-4fa7-afd7-080093e64471 deletion is rescheduled due to dependency. [ 1100.817358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.948177] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.450638] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.878441] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: SUCCESS [ 1101.878793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.953642] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.953871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.953957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.954283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.954412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.954551] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 1101.983042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.983259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.983259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.983427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.983578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.992891] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 1102.890032] env[70032]: INFO networking_nsxv3.common.synchronization [req-50ad0532-8c95-4dce-b2cb-0854ff2db636 req-b2a7f6e2-510c-466e-a702-a9c9b0a45edc tempest-ServerTagsTestJSON-6260335 tempest-ServerTagsTestJSON-6260335-project-member] Enqueued Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_members [ 1102.890032] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGHEST for action security_group_members [ 1102.890032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.890032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.890032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.890032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.890032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.890032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.890032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.890032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.890032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.890032] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.392883] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.393090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.393192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.393440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.393648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.393939] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.394076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.394173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.394420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.394552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.394789] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 is going to be updated. [ 1103.419559] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.419719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.419776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.420028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.420198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.428399] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 in Status: IN_PROGRESS for 2s [ 1104.001755] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1104.002159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.437355] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 in Status: SUCCESS [ 1105.437802] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 deletion is rescheduled due to dependency. [ 1105.437802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.584065] env[70032]: INFO networking_nsxv3.common.synchronization [None req-2309150b-cd30-4640-a2a6-0b69e0007d68 tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: ec9e9d28-0f97-4963-ad06-4255d6eb559c with Priority: HIGHEST for action security_group_rules [ 1107.584615] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec9e9d28-0f97-4963-ad06-4255d6eb559c with Priority: HIGHEST for action security_group_rules [ 1107.584920] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.585055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.585127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.585511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.585668] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec9e9d28-0f97-4963-ad06-4255d6eb559c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.669630] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ce60035c-b4ab-4711-b58c-d617efc43e26 tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: ec9e9d28-0f97-4963-ad06-4255d6eb559c with Priority: HIGHEST for action security_group_rules [ 1107.670295] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec9e9d28-0f97-4963-ad06-4255d6eb559c with Priority: HIGHEST for action security_group_rules [ 1107.670613] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.670722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.109319] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.109525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.109525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.109756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.109886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.109964] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec9e9d28-0f97-4963-ad06-4255d6eb559c already deleted. [ 1108.110073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.110237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.110400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.110528] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec9e9d28-0f97-4963-ad06-4255d6eb559c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.630023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.630332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.630332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.630458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.630549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.630649] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec9e9d28-0f97-4963-ad06-4255d6eb559c already deleted. [ 1108.630730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec9e9d28-0f97-4963-ad06-4255d6eb559c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.556037] env[70032]: INFO networking_nsxv3.common.synchronization [req-f4266722-861a-4bad-8ccd-e65ccf18e6db req-d9764b73-1df3-4af2-acff-b44e0e5a666a tempest-InstanceActionsTestJSON-1417141249 tempest-InstanceActionsTestJSON-1417141249-project-member] Enqueued Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_members [ 1109.556037] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_members [ 1109.556541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aeb2bb4-b636-44df-88aa-d607d160cac8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.556541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.556541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.556792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.556900] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.556998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.557071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.557298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.557453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.557562] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.894950] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.895276] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-152" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.895276] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-152" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.895583] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-152" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.895846] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.896046] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.896198] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.896426] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.896577] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.896805] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.896929] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.899491] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.899491] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.899491] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.899491] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.899491] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.915786] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.915786] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1109.915786] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.915786] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-152" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.915786] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.915786] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.915786] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.916182] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.916225] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.060916] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.061109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.061174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.061384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.061475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.061701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.061764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.061816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.061969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.062063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.062401] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 already deleted. [ 1110.062401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.418901] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.419162] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.419292] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.419591] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.419745] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.419904] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 not found, creating... [ 1110.420299] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.420406] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.420482] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.420729] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.420888] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.421195] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.421359] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.421473] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.421754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.421977] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.422054] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 is going to be created. [ 1110.440964] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.441238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.441329] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.441587] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.441816] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.442050] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.731271] env[70032]: INFO networking_nsxv3.common.synchronization [req-948c45e5-88ca-4bd4-acf6-0d96297d98bd req-c9a6f28c-4743-4e45-8dbe-78d03586ae7c tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1110.731797] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1110.732135] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.732258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.732328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.732534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.732682] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.732783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.732847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.732996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.733257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.733369] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.172663] env[70032]: INFO networking_nsxv3.common.synchronization [req-f4266722-861a-4bad-8ccd-e65ccf18e6db req-fc17a7d5-beed-4c7f-a6bb-46fdff39592a service nova] Enqueued Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_rules [ 1111.173065] env[70032]: INFO networking_nsxv3.common.synchronization [req-f4266722-861a-4bad-8ccd-e65ccf18e6db req-fc17a7d5-beed-4c7f-a6bb-46fdff39592a service nova] Enqueued Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_members [ 1111.173289] env[70032]: INFO networking_nsxv3.common.synchronization [req-f4266722-861a-4bad-8ccd-e65ccf18e6db req-fc17a7d5-beed-4c7f-a6bb-46fdff39592a service nova] Enqueued Resource ID: 8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 with Priority: HIGHEST for action port [ 1111.173848] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_rules [ 1111.174022] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_members [ 1111.174162] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 with Priority: HIGHEST for action port [ 1111.174511] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aeb2bb4-b636-44df-88aa-d607d160cac8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.174638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.174708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.174951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.175052] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.176309] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aeb2bb4-b636-44df-88aa-d607d160cac8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.178504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.178504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.178504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.178504] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.178504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.178504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.178504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.178504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.178504] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.179269] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.179269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.179269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.179269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.179269] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.235368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.235669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.235844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.236123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.236227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.237337] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.238239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.238239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.238239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.238239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.238239] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 already deleted. [ 1111.238239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.685146] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.685146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aeb2bb4-b636-44df-88aa-d607d160cac8 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.685146] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 with status ACTIVE [ 1111.685146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.685146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.685146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.685734] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.685734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.685734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.686071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.686194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.686299] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7 is going to be updated. [ 1111.706058] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.706197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.706270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.706470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.706605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.706778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5a7888-da9d-455b-8ea0-55a4ec7cbcf7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.085866] env[70032]: INFO networking_nsxv3.common.synchronization [None req-e5a6be7c-48ab-42e3-aded-82c23436cd6a tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1112.086498] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1112.086827] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.086980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.087931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.090202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.090329] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.189422] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.209665] env[70032]: INFO networking_nsxv3.common.synchronization [None req-90f3cb94-9235-4191-aa7a-8cd6b43a4a8e tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1112.210594] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1112.210906] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.211010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.598839] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1112.598991] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1112.615080] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.615234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.615294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.615503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.615587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.615681] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 already deleted. [ 1112.615757] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.616200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.616549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.616549] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.694496] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.694496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.694496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.694496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.694496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.694496] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 is going to be created. [ 1112.715270] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.717021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.717021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.717021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.717021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.737132] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 in Status: UNINITIALIZED for 2s [ 1113.138455] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.138633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.138731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.138998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.139138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.139284] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 already deleted. [ 1113.139393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.442750] env[70032]: INFO networking_nsxv3.common.synchronization [req-850b9e04-3e3f-4ad9-b561-c4dfe641efff req-8ffeac65-d974-45d2-bf10-d6bf7945a702 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_members [ 1114.443356] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_members [ 1114.443719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.443875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.443978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.444265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.444442] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.444570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.444654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.444833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.444958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.445078] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.747790] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 in Status: SUCCESS [ 1114.748045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.748210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.748419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.748604] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.748741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.748782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.748970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.749066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.749154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.749239] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.774454] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.774657] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.774784] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.775061] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.775339] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.775498] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.775616] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.775901] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.775977] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.776239] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.776384] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.776508] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.776659] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.776779] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.776889] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.777079] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.798020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.798020] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.798020] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.798020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.798020] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-da208c0f-4287-4bd0-ae61-b354e2af7f0b taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.798020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.798020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.798020] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.798020] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da208c0f-4287-4bd0-ae61-b354e2af7f0b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.950847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.950847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.950847] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc already deleted. [ 1114.950847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.251503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aeb2bb4-b636-44df-88aa-d607d160cac8 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.251650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.251718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.252234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.252884] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.253692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.253692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.254862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.255019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.255131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.255307] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aeb2bb4-b636-44df-88aa-d607d160cac8 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.255412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.255501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.255652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.255792] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.255897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.255945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.256088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.256168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.256249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.256336] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.302136] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.303085] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.303252] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.303548] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.303761] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.303937] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port da208c0f-4287-4bd0-ae61-b354e2af7f0b not found, creating... [ 1115.304226] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.304390] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.304512] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.304737] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.304885] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.307415] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.307415] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.307415] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.307577] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.308248] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.308248] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: da208c0f-4287-4bd0-ae61-b354e2af7f0b is going to be created. [ 1115.326165] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.326389] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.326517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.326998] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.327114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.327347] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.760960] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9aeb2bb4-b636-44df-88aa-d607d160cac8: rpc.has_security_group_logging(os_id): False [ 1115.779029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.779029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.779029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.779029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.779745] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.780033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.780229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.780483] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.780668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.780849] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 is going to be created. [ 1115.840675] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.843021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.843021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.843021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.843021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.851680] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 in Status: IN_PROGRESS for 2s [ 1116.344997] env[70032]: INFO networking_nsxv3.common.synchronization [req-850b9e04-3e3f-4ad9-b561-c4dfe641efff req-8650a4c9-2c7b-4f18-9430-403cb3079015 service nova] Enqueued Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_rules [ 1116.345202] env[70032]: INFO networking_nsxv3.common.synchronization [req-850b9e04-3e3f-4ad9-b561-c4dfe641efff req-8650a4c9-2c7b-4f18-9430-403cb3079015 service nova] Enqueued Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_members [ 1116.345343] env[70032]: INFO networking_nsxv3.common.synchronization [req-850b9e04-3e3f-4ad9-b561-c4dfe641efff req-8650a4c9-2c7b-4f18-9430-403cb3079015 service nova] Enqueued Resource ID: da208c0f-4287-4bd0-ae61-b354e2af7f0b with Priority: HIGHEST for action port [ 1116.345584] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_rules [ 1116.345711] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_members [ 1116.345868] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da208c0f-4287-4bd0-ae61-b354e2af7f0b with Priority: HIGHEST for action port [ 1116.346394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.346516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.346597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.346777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.346857] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.347864] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.347964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.348098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.348305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.348507] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.348631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.348713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.348907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.349040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.349174] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.352907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-da208c0f-4287-4bd0-ae61-b354e2af7f0b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.353022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.353106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.353264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.353343] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da208c0f-4287-4bd0-ae61-b354e2af7f0b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.855361] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.856069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.856069] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.856663] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da208c0f-4287-4bd0-ae61-b354e2af7f0b with status ACTIVE [ 1116.856860] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.856997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.857083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.857287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.857381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.857553] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.857643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.857765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.858638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.858638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.858638] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.858638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.858638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.859013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.859013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.859186] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da208c0f-4287-4bd0-ae61-b354e2af7f0b is going to be updated. [ 1116.879910] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.880227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.880363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.880563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.880733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.881078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da208c0f-4287-4bd0-ae61-b354e2af7f0b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.947072] env[70032]: INFO networking_nsxv3.common.synchronization [req-09dfc7f8-d758-4084-a57e-6edb21896e33 req-78b04214-dd5e-41c4-a14a-471226fe2935 tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1116.947645] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1116.947879] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.948012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.948085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.948333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.948480] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.948570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.948628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.948771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.948851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.948954] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.361081] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.423630] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.423950] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.424156] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.424501] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.424788] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.424990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.425280] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.425602] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.425698] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.426583] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.426724] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.426848] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.426977] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.427113] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.427237] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.427404] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.444991] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.445242] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.445401] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.445596] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.445958] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-b5750314-df31-4954-a5ad-fd1817ba3ed1 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.446168] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.446301] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.446621] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.446767] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5750314-df31-4954-a5ad-fd1817ba3ed1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.450934] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.451088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.451162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.451347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.451438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.451625] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.451723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.451786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.451930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.452015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.452102] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d already deleted. [ 1117.452181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.865352] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 in Status: SUCCESS [ 1117.865620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.866014] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.866145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.866192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.866392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.866473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.866589] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc is going to be created. [ 1117.898025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.898025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.898025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.898260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.898260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.908119] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc in Status: UNINITIALIZED for 2s [ 1117.950982] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.951283] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.951440] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.951758] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.951941] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.952130] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port b5750314-df31-4954-a5ad-fd1817ba3ed1 not found, creating... [ 1117.952456] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.952633] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.952772] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.953071] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.953243] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.953574] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.953774] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.953908] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.954402] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.954584] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.954759] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: b5750314-df31-4954-a5ad-fd1817ba3ed1 is going to be created. [ 1117.973734] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.974017] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.974199] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.974646] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.975060] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.975395] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.762787] env[70032]: INFO networking_nsxv3.common.synchronization [req-a07a109a-c2fa-4454-a60e-b8c943357588 req-d3b9c920-06ef-4c9d-8d3d-b324000cf02a tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 1118.763335] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 1118.764393] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.764393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.764393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.764393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.764393] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.764769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.764769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.764769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.764769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.764991] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.046990] env[70032]: INFO networking_nsxv3.common.synchronization [req-09dfc7f8-d758-4084-a57e-6edb21896e33 req-685c55c9-0ea8-4471-b847-65d8b3190eef service nova] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1119.047272] env[70032]: INFO networking_nsxv3.common.synchronization [req-09dfc7f8-d758-4084-a57e-6edb21896e33 req-685c55c9-0ea8-4471-b847-65d8b3190eef service nova] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1119.047640] env[70032]: INFO networking_nsxv3.common.synchronization [req-09dfc7f8-d758-4084-a57e-6edb21896e33 req-685c55c9-0ea8-4471-b847-65d8b3190eef service nova] Enqueued Resource ID: b5750314-df31-4954-a5ad-fd1817ba3ed1 with Priority: HIGHEST for action port [ 1119.047640] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1119.047811] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1119.047811] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5750314-df31-4954-a5ad-fd1817ba3ed1 with Priority: HIGHEST for action port [ 1119.054389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.054389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.054389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.054389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.054389] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.054922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.054922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.054922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.055127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.055315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.055450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.055521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.055684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.055755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.055841] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.057211] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5750314-df31-4954-a5ad-fd1817ba3ed1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.057316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.057369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.057515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.057584] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5750314-df31-4954-a5ad-fd1817ba3ed1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.267181] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.559579] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.559815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.559907] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.560938] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5750314-df31-4954-a5ad-fd1817ba3ed1 with status ACTIVE [ 1119.560990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.561139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.561341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.561449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.561536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.561714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.561810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.561877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.562032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.562114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.562297] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.562391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.562548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.562594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.562656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.562739] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5750314-df31-4954-a5ad-fd1817ba3ed1 is going to be updated. [ 1119.583753] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.583871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.583871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.584127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.584272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.584428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5750314-df31-4954-a5ad-fd1817ba3ed1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.682180] env[70032]: INFO networking_nsxv3.common.synchronization [req-7030d5ac-9a36-4846-af0a-923a6e2235ff req-be9d1b39-4e15-41ac-8109-7e14acc3f9bd tempest-VolumesAdminNegativeTest-1559699096 tempest-VolumesAdminNegativeTest-1559699096-project-member] Enqueued Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_members [ 1119.682773] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b9cad3-7556-42c3-8caf-441973387e39 with Priority: HIGHEST for action security_group_members [ 1119.683033] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b9cad3-7556-42c3-8caf-441973387e39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.683144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.683316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.683406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.683554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.683651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.683714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.683855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.684085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.684185] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b9cad3-7556-42c3-8caf-441973387e39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.772075] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.919476] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc in Status: SUCCESS [ 1119.919685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.921541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.921541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.921541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.921541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.921541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.921541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.921541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.921541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.921541] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.956182] env[70032]: INFO networking_nsxv3.common.synchronization [req-f03d193f-87d4-424b-b664-5b4c535e48ba req-6f327054-07fc-45e9-8c98-a8f4f9e6f138 tempest-ServersAdminNegativeTestJSON-1963466895 tempest-ServersAdminNegativeTestJSON-1963466895-project-member] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1119.956719] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1119.957089] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.957219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.957288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.957589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.957746] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.957850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.957987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.958294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.958391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.958497] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.066764] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.186588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.186706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.186747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.186930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.207689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.207985] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.208140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.208215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.208404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.208486] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.208580] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b9cad3-7556-42c3-8caf-441973387e39 is going to be updated. [ 1120.232882] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.233076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.233126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.233347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.233893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.238450] env[70032]: INFO networking_nsxv3.common.synchronization [None req-faf63a5a-3ba2-4cae-b306-b452d797007b None None] Enqueued Resource ID: 2a8d0f22-0084-4202-8c74-f48ee598f973 with Priority: HIGHEST for action port [ 1120.239487] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8d0f22-0084-4202-8c74-f48ee598f973 with Priority: HIGHEST for action port [ 1120.239817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a8d0f22-0084-4202-8c74-f48ee598f973 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.239940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a8d0f22-0084-4202-8c74-f48ee598f973" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.240581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a8d0f22-0084-4202-8c74-f48ee598f973" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.243995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a8d0f22-0084-4202-8c74-f48ee598f973" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.246823] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a8d0f22-0084-4202-8c74-f48ee598f973',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.246823] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b9cad3-7556-42c3-8caf-441973387e39 in Status: IN_PROGRESS for 2s [ 1120.274585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.275895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.275895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.278920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.278920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.278920] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be updated. [ 1120.318275] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.318727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.318890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.319188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.319782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.328592] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: IN_PROGRESS for 2s [ 1120.427395] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.464048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.464048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.464173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.464802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.464802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.464802] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.464802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.464802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.466317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.466317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.466317] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e already deleted. [ 1120.466317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.471366] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.471579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.471734] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.472007] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.472297] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.472485] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.472838] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.473489] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.473934] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.474208] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.474688] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.474852] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.474982] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.475137] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.475357] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.475624] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.507265] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.507931] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1120.507931] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.507931] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.509539] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-59915f60-0174-4a6c-94eb-ecfab2fa1623 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.509539] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.509730] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.509959] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.510132] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59915f60-0174-4a6c-94eb-ecfab2fa1623',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.571415] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.571415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.571415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.571415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.571415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.571415] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be created. [ 1120.606373] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.606482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.606482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.609365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.609365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.626919] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: UNINITIALIZED for 2s [ 1120.748591] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a8d0f22-0084-4202-8c74-f48ee598f973 [ 1120.748737] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.749105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.749273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.749573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.749739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.749932] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a8d0f22-0084-4202-8c74-f48ee598f973 already deleted. [ 1120.750109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a8d0f22-0084-4202-8c74-f48ee598f973" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.895063] env[70032]: INFO networking_nsxv3.common.synchronization [None req-67f16847-600e-4818-b487-bce545813c24 tempest-ServersTestBootFromVolume-1935082994 tempest-ServersTestBootFromVolume-1935082994-project-member] Enqueued Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_rules [ 1120.895262] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_rules [ 1120.896020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.896020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.896020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.896020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.896020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.931990] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1c12e03-bdb4-4d99-81b1-a03d701f2dfc: rpc.has_security_group_logging(os_id): False [ 1120.957222] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.957468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.957468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.957963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.957963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.958050] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.958108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.958187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.958318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.958399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.958492] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc is going to be created. [ 1121.015439] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.015611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.015669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.015895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.016144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.017795] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.019116] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.019300] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.019816] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.019816] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.019913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 59915f60-0174-4a6c-94eb-ecfab2fa1623 not found, creating... [ 1121.023018] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.023018] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.023018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.023497] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 59915f60-0174-4a6c-94eb-ecfab2fa1623 is going to be created. [ 1121.037430] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc in Status: IN_PROGRESS for 2s [ 1121.046170] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.046462] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.046733] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.047208] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.047731] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.047986] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.105918] env[70032]: INFO networking_nsxv3.common.synchronization [None req-fb97e0aa-8491-4b0b-989a-ee2476cd7fc1 tempest-ServersTestBootFromVolume-1935082994 tempest-ServersTestBootFromVolume-1935082994-project-member] Enqueued Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_rules [ 1121.108016] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_rules [ 1121.108820] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.110972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.417440] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.417440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.417440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.417440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.417440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.417440] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 already deleted. [ 1121.417440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.417440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.418231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.418231] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.938881] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.939087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.939166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.939377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.939468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.939566] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 already deleted. [ 1121.939649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.978163] env[70032]: INFO networking_nsxv3.common.synchronization [req-f03d193f-87d4-424b-b664-5b4c535e48ba req-6a3e48d6-7866-48a1-8ec2-223ca47b935a service nova] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_rules [ 1121.978439] env[70032]: INFO networking_nsxv3.common.synchronization [req-f03d193f-87d4-424b-b664-5b4c535e48ba req-6a3e48d6-7866-48a1-8ec2-223ca47b935a service nova] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1121.978525] env[70032]: INFO networking_nsxv3.common.synchronization [req-f03d193f-87d4-424b-b664-5b4c535e48ba req-6a3e48d6-7866-48a1-8ec2-223ca47b935a service nova] Enqueued Resource ID: 59915f60-0174-4a6c-94eb-ecfab2fa1623 with Priority: HIGHEST for action port [ 1121.978724] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_rules [ 1121.978973] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1121.978973] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59915f60-0174-4a6c-94eb-ecfab2fa1623 with Priority: HIGHEST for action port [ 1121.979514] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.979635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.980204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.980204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.980619] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.981703] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.981855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.981927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.982160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.982314] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.984803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.984803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.984803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.984803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.984803] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.984803] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-59915f60-0174-4a6c-94eb-ecfab2fa1623 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.984803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.984803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.984803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.984803] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59915f60-0174-4a6c-94eb-ecfab2fa1623',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.257540] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b9cad3-7556-42c3-8caf-441973387e39 in Status: SUCCESS [ 1122.257777] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b9cad3-7556-42c3-8caf-441973387e39 deletion is rescheduled due to dependency. [ 1122.257777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b9cad3-7556-42c3-8caf-441973387e39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.344125] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 1122.344338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.482992] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.483222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.486729] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.488071] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59915f60-0174-4a6c-94eb-ecfab2fa1623 with status ACTIVE [ 1122.488368] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.489362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.489362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.489362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.489362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.489510] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.489654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.489720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.490327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.490327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.490665] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.490840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.490967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.491240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.491396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.491556] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59915f60-0174-4a6c-94eb-ecfab2fa1623 is going to be updated. [ 1122.514769] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.514769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.514769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.514769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.514769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.514769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59915f60-0174-4a6c-94eb-ecfab2fa1623" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.636841] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1122.637090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.637266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.637480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.637685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.637790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.637854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.638042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.638128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.638213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.638306] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.822722] env[70032]: INFO networking_nsxv3.common.synchronization [None req-cd6f1f86-1b15-41ae-b4fa-137dc3357868 None None] Enqueued Resource ID: 3a58c4ff-6ce6-4282-be6d-417f66d6bc3c with Priority: HIGHEST for action port [ 1122.822988] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a58c4ff-6ce6-4282-be6d-417f66d6bc3c with Priority: HIGHEST for action port [ 1122.823611] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a58c4ff-6ce6-4282-be6d-417f66d6bc3c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.823718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a58c4ff-6ce6-4282-be6d-417f66d6bc3c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.823778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a58c4ff-6ce6-4282-be6d-417f66d6bc3c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.824133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a58c4ff-6ce6-4282-be6d-417f66d6bc3c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.824133] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a58c4ff-6ce6-4282-be6d-417f66d6bc3c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.994301] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.050582] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc in Status: SUCCESS [ 1123.050805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.142496] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.328111] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a58c4ff-6ce6-4282-be6d-417f66d6bc3c [ 1123.328442] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.328502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.328642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.328822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.328987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.328987] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a58c4ff-6ce6-4282-be6d-417f66d6bc3c already deleted. [ 1123.329691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a58c4ff-6ce6-4282-be6d-417f66d6bc3c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.497854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.497854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.497854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.497854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.497854] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.497854] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be created. [ 1123.524192] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.524372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.524447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.524670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.524851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.534161] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: UNINITIALIZED for 2s [ 1123.645117] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f8ad78a-3466-4ff5-8d70-3fec6284010d: rpc.has_security_group_logging(os_id): False [ 1123.666263] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.666461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.666461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.666674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.666759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.667016] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.667127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.667192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.667347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.667422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.667513] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be created. [ 1123.750737] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.750960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.751181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.751845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.751845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.764255] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1125.473823] env[70032]: INFO networking_nsxv3.common.synchronization [req-3a8df938-7292-4df5-8aa4-50d3258f3763 req-45e3347f-a90f-417b-8e4c-665a58b66afd tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1125.474373] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1125.474670] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.474793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.474860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.475299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.475521] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.475655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.475835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.476054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.476178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.476296] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.516970] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b1fa7a44-b555-44f9-9fb9-f1a045bd302c None None] Enqueued Resource ID: 2989c7aa-7988-4261-8448-64e9790fffbc with Priority: HIGHEST for action port [ 1125.517647] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989c7aa-7988-4261-8448-64e9790fffbc with Priority: HIGHEST for action port [ 1125.518029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2989c7aa-7988-4261-8448-64e9790fffbc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.518146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2989c7aa-7988-4261-8448-64e9790fffbc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.518213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2989c7aa-7988-4261-8448-64e9790fffbc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.518465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2989c7aa-7988-4261-8448-64e9790fffbc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.518548] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2989c7aa-7988-4261-8448-64e9790fffbc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.549868] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1125.549868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.550370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.550582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.550782] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.550954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.550954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.551115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.551195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.551281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.551373] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.775190] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1125.775466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.979702] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.021965] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2989c7aa-7988-4261-8448-64e9790fffbc [ 1126.022178] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.022348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.022462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.022702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.022810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.022926] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2989c7aa-7988-4261-8448-64e9790fffbc already deleted. [ 1126.023028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2989c7aa-7988-4261-8448-64e9790fffbc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.054913] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.054913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.054913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.055130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.055159] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.055268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.055352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.056554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.056554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.056554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.056878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.056878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.056878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.056878] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.485054] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.563025] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e: rpc.has_security_group_logging(os_id): False [ 1126.580938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.581179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.581255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.582031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.582132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.582744] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.582744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.582744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.582744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.582925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.582957] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.583294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.583367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.583953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.583953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.583953] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.583953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.583953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.585341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.585453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.586085] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be created. [ 1126.643024] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.643024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.643024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.643024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.643024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.647254] env[70032]: INFO networking_nsxv3.common.synchronization [None req-89a6ae9d-ff07-485a-98cf-46f9d4cf29db tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1126.647931] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1126.648781] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.649058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.649211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.649579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.649782] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.654708] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: IN_PROGRESS for 2s [ 1126.756707] env[70032]: INFO networking_nsxv3.common.synchronization [None req-bbc50346-2874-4b36-82cd-ffec1f3b6d96 tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1126.757224] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1126.757525] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.757626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.991233] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.991372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.991372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.991618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.992043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.992183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 1127.033559] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.033713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.033797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.034039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.034187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.045652] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 1127.184679] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.184988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.184988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.185464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.185464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.185464] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 already deleted. [ 1127.185464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.186270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.186270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.186270] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.472918] env[70032]: INFO networking_nsxv3.common.synchronization [None req-ec8fa459-0bde-4c80-bd20-b1345ed6325b None None] Enqueued Resource ID: b94ab48d-46fe-4927-b129-fe233300b370 with Priority: HIGHEST for action port [ 1127.473198] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b94ab48d-46fe-4927-b129-fe233300b370 with Priority: HIGHEST for action port [ 1127.473775] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b94ab48d-46fe-4927-b129-fe233300b370 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.473946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b94ab48d-46fe-4927-b129-fe233300b370" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.474043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b94ab48d-46fe-4927-b129-fe233300b370" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.474309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b94ab48d-46fe-4927-b129-fe233300b370" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.474392] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b94ab48d-46fe-4927-b129-fe233300b370',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.707930] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.708309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.708309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.708531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.708531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.708638] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 already deleted. [ 1127.708713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.825680] env[70032]: INFO networking_nsxv3.common.synchronization [req-604ea3ce-3837-4f3e-b2be-88fe722a2068 req-cbbb1ea3-4553-40d6-8638-72b688a34a79 tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1127.826392] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1127.826736] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.826867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.826917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.827225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.827380] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.827485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.827548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.827696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.827809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.827893] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.977174] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b94ab48d-46fe-4927-b129-fe233300b370 [ 1127.977801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.977801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.977801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.977967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.978251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.978346] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b94ab48d-46fe-4927-b129-fe233300b370 already deleted. [ 1127.978493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b94ab48d-46fe-4927-b129-fe233300b370" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.337500] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.337671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.337738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.338106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.338106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.338343] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.338343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.338494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.338655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.338655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.338655] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 already deleted. [ 1128.338858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.358667] env[70032]: INFO networking_nsxv3.common.synchronization [req-8127d90c-e466-438c-ba5e-cc5ddec6955b req-6d1760b0-a6a5-4819-82a7-b7a98e4bc367 tempest-InstanceActionsTestJSON-1417141249 tempest-InstanceActionsTestJSON-1417141249-project-member] Enqueued Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_members [ 1128.360961] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 with Priority: HIGHEST for action security_group_members [ 1128.362241] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aeb2bb4-b636-44df-88aa-d607d160cac8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.363029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.363240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.364194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.364394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.364505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.364568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.364739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.364820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.364912] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aeb2bb4-b636-44df-88aa-d607d160cac8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.489098] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.489327] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.489457] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.489736] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.490010] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.490187] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.490305] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.490629] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.490794] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.491403] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.491789] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.492133] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.492301] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.492810] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.493109] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.493278] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.513516] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.513750] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1128.514688] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.514688] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.514688] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-791d1638-58f3-4518-82fc-3305161672b7 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.514688] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.515057] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.515108] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.515848] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('791d1638-58f3-4518-82fc-3305161672b7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.667133] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1128.667133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.868818] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.869150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.869150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.869444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.869444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.869705] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.869705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.869705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.869884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.869913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.869991] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 is going to be updated. [ 1128.894445] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.894647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.894726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.894940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.895100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.902751] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 in Status: IN_PROGRESS for 2s [ 1129.021064] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.021064] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 791d1638-58f3-4518-82fc-3305161672b7 not found, creating... [ 1129.021064] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.021064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.021477] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.021477] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.021477] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.021742] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.021983] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.022249] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 791d1638-58f3-4518-82fc-3305161672b7 is going to be created. [ 1129.048050] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.048050] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.048050] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.048050] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.048050] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.048050] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.058979] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1129.058979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.761484] env[70032]: INFO networking_nsxv3.common.synchronization [req-604ea3ce-3837-4f3e-b2be-88fe722a2068 req-cfbb4d57-7e34-4066-9b83-2b6375fb99b4 service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 1129.761676] env[70032]: INFO networking_nsxv3.common.synchronization [req-604ea3ce-3837-4f3e-b2be-88fe722a2068 req-cfbb4d57-7e34-4066-9b83-2b6375fb99b4 service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1129.761823] env[70032]: INFO networking_nsxv3.common.synchronization [req-604ea3ce-3837-4f3e-b2be-88fe722a2068 req-cfbb4d57-7e34-4066-9b83-2b6375fb99b4 service nova] Enqueued Resource ID: 791d1638-58f3-4518-82fc-3305161672b7 with Priority: HIGHEST for action port [ 1129.762069] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 1129.762196] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1129.762569] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 791d1638-58f3-4518-82fc-3305161672b7 with Priority: HIGHEST for action port [ 1129.762831] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.762941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.763189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.763461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.763579] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.764918] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.765081] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.765709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.765709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.765709] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.765709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.765709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.765947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.765947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.766352] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.766973] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-791d1638-58f3-4518-82fc-3305161672b7 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.767067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.767186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.767549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.767670] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('791d1638-58f3-4518-82fc-3305161672b7',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.269492] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.270899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.270899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.270899] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 791d1638-58f3-4518-82fc-3305161672b7 with status ACTIVE [ 1130.270899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.271215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.271215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.271272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.272035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.272035] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.272035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.272035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.272035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.272035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.272244] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.272244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.272244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.272338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.272451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.272492] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 791d1638-58f3-4518-82fc-3305161672b7 is going to be updated. [ 1130.291210] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.291210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.291437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.291513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.292167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.292167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-791d1638-58f3-4518-82fc-3305161672b7" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.774781] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.933851] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 in Status: SUCCESS [ 1130.934123] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aeb2bb4-b636-44df-88aa-d607d160cac8 deletion is rescheduled due to dependency. [ 1130.934248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aeb2bb4-b636-44df-88aa-d607d160cac8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.276941] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.277285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.277285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.277499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.277616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.277739] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 1131.294775] env[70032]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'data': {'id': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'display_name': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'path': '/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'expression': [{'value': 'security_group|1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['192.168.128.13']}], 'tags': [{'scope': 'age', 'tag': 1743816145}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500127,\n "module_name" : "Policy",\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\n}' [ 1131.294963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.295147] env[70032]: Traceback (most recent call last): [ 1131.295188] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1131.295188] env[70032]: listener.cb(fileno) [ 1131.295188] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1131.295188] env[70032]: result = function(*args, **kwargs) [ 1131.295188] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 178, in security_group_members [ 1131.295188] env[70032]: self.nsx_provider.sg_members_realize( [ 1131.295188] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1030, in sg_members_realize [ 1131.295188] env[70032]: return self._realize(Provider.SG_MEMBERS, delete, self.payload.sg_members_container, os_sg, provider_group) [ 1131.295188] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1131.295188] env[70032]: return func(*args, **kwargs) [ 1131.295188] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 785, in _realize [ 1131.295188] env[70032]: res = self.client.put(path=path, data=data) [ 1131.295188] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 125, in decorator [ 1131.295188] env[70032]: raise RuntimeError(msg, last_err) [ 1131.295188] env[70032]: RuntimeError: (None, 'Error Code=400 Message=b\'{\\n "httpStatus" : "BAD_REQUEST",\\n "error_code" : 500127,\\n "module_name" : "Policy",\\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\\n}\'') [ 1131.295188] env[70032]: Removing descriptor: 68 [ 1131.295564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.295621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.295765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.295884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.296125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.296377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.296479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.296550] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.800182] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.306569] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.398951] env[70032]: INFO networking_nsxv3.common.synchronization [req-018527a6-acda-496e-b13a-f6bc671d99f2 req-b3109c9f-588b-43e2-914b-d8310015a791 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1132.399635] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1132.399966] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.402980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.402980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.402980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.402980] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.402980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.402980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.402980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.402980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.402980] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.782178] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.782402] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.782540] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.782817] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.783099] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.783289] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.783414] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.783657] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.783815] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.784517] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.784517] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.784517] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.784517] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.784517] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.784917] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.784917] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.803035] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.803260] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.803412] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.803585] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.803932] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-4fe44080-4ef7-4f1d-a92b-5eb50928e912 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.804141] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.804278] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.804614] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.804781] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fe44080-4ef7-4f1d-a92b-5eb50928e912',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.811269] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.811269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.811269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.811269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.811269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.811269] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be created. [ 1132.825139] env[70032]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'data': {'id': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'display_name': '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'path': '/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'expression': [{'value': 'security_group|1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['192.168.128.13']}], 'tags': [{'scope': 'age', 'tag': 1743816146}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500127,\n "module_name" : "Policy",\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\n}' [ 1132.825275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.825379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.825558] env[70032]: Traceback (most recent call last): [ 1132.825616] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1132.825616] env[70032]: listener.cb(fileno) [ 1132.825616] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1132.825616] env[70032]: result = function(*args, **kwargs) [ 1132.825616] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 194, in security_group_rules [ 1132.825616] env[70032]: self.security_group_members(os_id, reference=True) [ 1132.825616] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 178, in security_group_members [ 1132.825616] env[70032]: self.nsx_provider.sg_members_realize( [ 1132.825616] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1030, in sg_members_realize [ 1132.825616] env[70032]: return self._realize(Provider.SG_MEMBERS, delete, self.payload.sg_members_container, os_sg, provider_group) [ 1132.825616] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1132.825616] env[70032]: return func(*args, **kwargs) [ 1132.825616] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 785, in _realize [ 1132.825616] env[70032]: res = self.client.put(path=path, data=data) [ 1132.825616] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 125, in decorator [ 1132.825616] env[70032]: raise RuntimeError(msg, last_err) [ 1132.825616] env[70032]: RuntimeError: (None, 'Error Code=400 Message=b\'{\\n "httpStatus" : "BAD_REQUEST",\\n "error_code" : 500127,\\n "module_name" : "Policy",\\n "error_message" : "Cannot create an object with path=[/infra/domains/default/groups/1f0e8ca4-9613-4991-a992-cf2ef6089b55] as it already exists."\\n}\'') [ 1132.825616] env[70032]: Removing descriptor: 68 [ 1132.908180] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.908392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.908465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.908680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.908774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.909507] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.909507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.909507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.909507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.909507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.909507] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 already deleted. [ 1132.909507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.307241] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.307629] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.307629] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.307878] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.308054] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.308298] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 4fe44080-4ef7-4f1d-a92b-5eb50928e912 not found, creating... [ 1133.308571] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.308733] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.308854] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.309171] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.309356] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.309656] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.309816] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.309937] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.310168] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.310310] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.310455] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 4fe44080-4ef7-4f1d-a92b-5eb50928e912 is going to be created. [ 1133.329561] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.329726] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.329858] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.330171] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.330455] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.330696] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.105640] env[70032]: INFO networking_nsxv3.common.synchronization [req-018527a6-acda-496e-b13a-f6bc671d99f2 req-3744fd54-04f9-43a7-8b19-2bdb362945c0 service nova] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1134.105830] env[70032]: INFO networking_nsxv3.common.synchronization [req-018527a6-acda-496e-b13a-f6bc671d99f2 req-3744fd54-04f9-43a7-8b19-2bdb362945c0 service nova] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1134.106012] env[70032]: INFO networking_nsxv3.common.synchronization [req-018527a6-acda-496e-b13a-f6bc671d99f2 req-3744fd54-04f9-43a7-8b19-2bdb362945c0 service nova] Enqueued Resource ID: 4fe44080-4ef7-4f1d-a92b-5eb50928e912 with Priority: HIGHEST for action port [ 1134.106235] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1134.106366] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1134.106518] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe44080-4ef7-4f1d-a92b-5eb50928e912 with Priority: HIGHEST for action port [ 1134.108576] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.108786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.108881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.109115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.109219] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.110210] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.110327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.110437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.114022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.114022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.114022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.114022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.114022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.114022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.114022] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.116448] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fe44080-4ef7-4f1d-a92b-5eb50928e912 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.117427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.117557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.117823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.117914] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fe44080-4ef7-4f1d-a92b-5eb50928e912',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.620205] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.621578] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.621578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.621578] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fe44080-4ef7-4f1d-a92b-5eb50928e912 with status ACTIVE [ 1134.621771] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.621826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.621893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.622116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.622204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.622373] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.622467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.622527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.622676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.622775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.622942] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.623494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.623592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.623747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.623824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.624026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fe44080-4ef7-4f1d-a92b-5eb50928e912 is going to be updated. [ 1134.644088] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.644088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.644088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.644241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.644434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.644542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fe44080-4ef7-4f1d-a92b-5eb50928e912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.127029] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.630508] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.630508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.630508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.630911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.630911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.630911] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 is going to be created. [ 1135.654887] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.655055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.655127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.655351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.655513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.670091] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: UNINITIALIZED for 2s [ 1136.600477] env[70032]: INFO networking_nsxv3.common.synchronization [req-ce3f7f9d-ad1e-45ab-9c0c-f3590661beeb req-9ebc50fb-9d32-42c5-ab0d-0139b1f3aec7 tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1136.600979] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1136.601302] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.601425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.601493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.601695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.601847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.601943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.602017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.602186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.602272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.602362] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.900468] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.900773] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.900827] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.901069] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.901332] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.901491] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.901613] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.901832] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.901985] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.902209] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.902331] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.902446] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.902557] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.902671] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.902782] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.902919] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.922401] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.922566] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.922703] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.922879] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.923293] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-68c6d75c-119b-44ef-9088-7f09360a17ba taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.923476] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.923908] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.923908] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.924091] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c6d75c-119b-44ef-9088-7f09360a17ba',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.104340] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.104340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.104340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.104549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.104650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.104847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.104948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.105020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.105173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.105278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.105377] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1137.129724] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.129884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.129935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.130123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.130259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.138499] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1137.426678] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.426930] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.427072] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.427360] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.427523] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.427681] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 68c6d75c-119b-44ef-9088-7f09360a17ba not found, creating... [ 1137.427943] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.428150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.428277] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.428501] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.428642] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.428993] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.429211] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.429329] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.429545] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.429688] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.429831] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 68c6d75c-119b-44ef-9088-7f09360a17ba is going to be created. [ 1137.450576] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.450792] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.450921] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.451204] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.451451] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.451674] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.682054] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: SUCCESS [ 1137.682253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.682448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.682761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.682984] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.683117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.683184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.683338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.683416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.683499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.683589] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.186802] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.201520] env[70032]: INFO networking_nsxv3.common.synchronization [req-ce3f7f9d-ad1e-45ab-9c0c-f3590661beeb req-9e9d35a2-b0d9-4605-a806-c0e2a216c382 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 1138.201520] env[70032]: INFO networking_nsxv3.common.synchronization [req-ce3f7f9d-ad1e-45ab-9c0c-f3590661beeb req-9e9d35a2-b0d9-4605-a806-c0e2a216c382 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1138.201520] env[70032]: INFO networking_nsxv3.common.synchronization [req-ce3f7f9d-ad1e-45ab-9c0c-f3590661beeb req-9e9d35a2-b0d9-4605-a806-c0e2a216c382 service nova] Enqueued Resource ID: 68c6d75c-119b-44ef-9088-7f09360a17ba with Priority: HIGHEST for action port [ 1138.201520] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 1138.201520] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1138.201520] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c6d75c-119b-44ef-9088-7f09360a17ba with Priority: HIGHEST for action port [ 1138.204921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.204921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.204921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.204921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.204921] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.204921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.204921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.204921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-68c6d75c-119b-44ef-9088-7f09360a17ba taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.204921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.204921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.204921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.204921] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c6d75c-119b-44ef-9088-7f09360a17ba',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.692324] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec6619bd-9b1f-429e-957b-14f3db7e57f0: rpc.has_security_group_logging(os_id): False [ 1138.705646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.705792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.707154] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68c6d75c-119b-44ef-9088-7f09360a17ba with status ACTIVE [ 1138.707352] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.707495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.707572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.707813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.707903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.708098] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.708226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.708301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.708455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.708546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.708744] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.708850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.708892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.709056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.710024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.710024] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68c6d75c-119b-44ef-9088-7f09360a17ba is going to be updated. [ 1138.711099] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.711210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.711292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.711517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.711582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.711770] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.711866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.711925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.712092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.712169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.712269] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 is going to be created. [ 1138.732965] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.733118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.733193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.733555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.733736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.733944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68c6d75c-119b-44ef-9088-7f09360a17ba" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.770844] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.771220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.771220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.771430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.771467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.782913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: IN_PROGRESS for 2s [ 1139.155580] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1139.155772] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 1139.155894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.156076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.156326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.156519] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.156680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.156740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.156848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.156940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.157144] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.659771] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.161194] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.663754] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.664374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.665057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.665809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.666159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.669839] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1140.698231] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.698407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.698547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.698806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.699015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.709025] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1140.795536] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: SUCCESS [ 1140.795870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.063601] env[70032]: INFO networking_nsxv3.common.synchronization [req-8a18eebf-ea32-4a47-8dde-92ad6c18d2da req-69d89bb0-3450-4719-932d-a46a5d6059fa tempest-ServersV294TestFqdnHostnames-1130357765 tempest-ServersV294TestFqdnHostnames-1130357765-project-member] Enqueued Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_members [ 1141.064564] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGHEST for action security_group_members [ 1141.065417] env[70032]: INFO networking_nsxv3.common.synchronization [req-d34e6599-4221-45be-b2c6-674d3dbfb0d5 req-61be683d-3fc7-4d9f-a27c-9a34b380451c tempest-ServerRescueNegativeTestJSON-1289274982 tempest-ServerRescueNegativeTestJSON-1289274982-project-member] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 1141.065938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.066173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.066838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.066838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.066838] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.066838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.066838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.067095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.067095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.067159] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.069059] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGHEST for action security_group_members [ 1141.069497] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.069606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.069672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.069830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.069970] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.070075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.070135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.070275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.070358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.070442] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.570691] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.570865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.570934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.571185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.571284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.571487] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.571584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.571647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.571797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.571875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.571970] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae is going to be updated. [ 1141.573407] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.573519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.573586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.573739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.573987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.573987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.574123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.574154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.574270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.574332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.574451] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be updated. [ 1141.607241] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.607391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.607451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.607654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.607790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.616492] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.616622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.616684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.616874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.617016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.619667] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: IN_PROGRESS for 2s [ 1141.623047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae in Status: IN_PROGRESS for 2s [ 1142.536982] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.537384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.537384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.537450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.537565] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.717996] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1142.718438] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.718890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.724018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.724018] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.724018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.724018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.724018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.724018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.724018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.724018] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.040034] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.230207] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.230412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.230487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.230672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.230893] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.230976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.231016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.231167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.231274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.231336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.231521] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.231620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.231620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.231739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.231917] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.232044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.232044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.232237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.232237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.232317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.232430] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.543274] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.634141] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae in Status: SUCCESS [ 1143.636340] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae deletion is rescheduled due to dependency. [ 1143.636340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.636340] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 in Status: SUCCESS [ 1143.636340] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 deletion is rescheduled due to dependency. [ 1143.636340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.739375] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac44685-7555-444d-b1ce-19ece671a825: rpc.has_security_group_logging(os_id): False [ 1143.759166] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.759166] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.759166] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.759166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.759707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.759707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.759707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.759707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.759707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.759707] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1143.817731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.819069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.819302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.819910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.823029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.836309] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1144.045632] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1144.045755] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1144.922600] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.922907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.922907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.923140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.939650] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1144.941035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.942694] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1144.984107] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.984107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.984107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.984107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.008405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.008405] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1145.008692] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1145.009035] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1145.063184] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.063184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.063184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.063184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.063184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.063184] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1145.177065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.183944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.183944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.183944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.183944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.183944] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1145.289025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.289025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.289025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.289025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.289025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.289025] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1145.289025] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e2ef9c9c-f8d6-4b45-b624-16d16cab2727', 'f8f37877-f530-4fa7-afd7-080093e64471', '17fd7384-1e1f-4823-baff-e68bca324f40', '750167f1-a8ae-4a8e-a9a0-cd5ce2550684', 'c2546188-fcd4-4401-b075-87ffd0e4a9a9', '6cc2a59a-272e-4f81-9b52-f6c080a526ae', 'b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e', '26d43c7c-82c8-4a83-8478-40e297491039', 'c991b17e-e013-4122-96ca-aa291400f826', '57166f3a-68e3-48b8-984a-2376cb60573f', '57ba5aef-2625-46a9-b4f6-3654836e0f13', 'c1d61d13-44e5-4c83-936b-8a6c378d760a', '14c7722e-02ea-467c-af4c-394e1f839b23', '1f0e8ca4-9613-4991-a992-cf2ef6089b55', '7dc6b078-d4c5-4e0d-955f-af7c0818a2ae', 'b1393cc3-6b9b-4326-8077-4648511fe41e', '1ac44685-7555-444d-b1ce-19ece671a825', '0af6e748-3c4e-4f35-8470-0d9bbc423daa', 'd880077d-b1e8-47fa-bc09-7da9308456b0', '0133496a-f61f-45f7-a024-b9b137774b66', '61533d93-47dd-40b4-b191-9d366077f93c', '1e94337d-b9be-48c8-8c35-01c45e2baf7c', 'b1c12e03-bdb4-4d99-81b1-a03d701f2dfc', 'c26164ff-f3d0-4ac4-97ed-86984dd723e3', 'a60e0c43-f06a-467e-816b-4e256badc10b', '00b9cad3-7556-42c3-8caf-441973387e39', 'd451476b-b529-46a5-ac42-f7b74140c983', '0d217ae0-b74a-4bed-9ca6-45df455c7a58', '4e2dd745-ad31-4195-9f0e-c534fa480580', '5000c8de-0235-4e38-93be-83111bb42b93', 'ec6619bd-9b1f-429e-957b-14f3db7e57f0', '449f8b7d-089e-4037-adbd-8e1125cab8b6', '8d6919e6-e32b-4e99-b10c-70b263dc0104', '3f8ad78a-3466-4ff5-8d70-3fec6284010d', 'f3034974-c557-4de5-9753-a08e1f169c15', 'f5730a18-9b02-4aad-abe1-e7789de465fd', '00371e37-ee75-4ff4-9639-24f7314003da', 'bb0f9ea3-e335-4804-8789-09a66f5ffeef', 'c54f2196-33e3-453f-a911-75188cea4a01', '8ab8694e-7329-47c5-b4fe-30318bb49368', 'bccc08ea-f041-453a-b54a-615933f6cecf', '42d4b17b-1bab-41c3-94ca-ac72b8e35f54', '9aeb2bb4-b636-44df-88aa-d607d160cac8', '27ec5bcd-a30c-4400-8500-5f69d46c0d4f', 'b20098c3-4944-4612-af2a-f2d01874388d'} {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1145.289025] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1145.293835] env[70032]: INFO networking_nsxv3.common.synchronization [req-44d8a827-32b4-406f-bd48-cd6b7d634b9e req-222b1a8e-a080-49dd-906e-eb1496c5d83e tempest-ServersAdminTestJSON-592942915 tempest-ServersAdminTestJSON-592942915-project-member] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1145.294979] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGHEST for action security_group_members [ 1145.295490] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.295750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.295930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.296245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.296840] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.297126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.297329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.297622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.297829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.298647] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.319247] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.319247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.319247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.319247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.319247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.319247] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1145.319247] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1145.319247] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1145.399518] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.399683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.399728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.404051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.404051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.404051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1145.404051] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1145.404051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1145.404051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1145.404051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGH for action security_group_rules [ 1145.404051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.800870] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.801061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.801133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.801436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.820160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.820432] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.820556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.820622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.823821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.823821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.823821] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be updated. [ 1145.846430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.846567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.846657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.846862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.847015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.848500] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1145.848672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.853778] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: IN_PROGRESS for 2s [ 1146.817314] env[70032]: INFO networking_nsxv3.common.synchronization [req-6a8915c3-f363-48eb-8ec8-d8f3526e07d8 req-2870d8fc-526c-4793-a9ff-202fdc021656 tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17fd7384-1e1f-4823-baff-e68bca324f40 with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0133496a-f61f-45f7-a024-b9b137774b66 with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1393cc3-6b9b-4326-8077-4648511fe41e with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c7722e-02ea-467c-af4c-394e1f839b23 with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d61d13-44e5-4c83-936b-8a6c378d760a with Priority: HIGH for action security_group_rules [ 1146.820035] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 with Priority: HIGH for action security_group_rules [ 1146.820861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57166f3a-68e3-48b8-984a-2376cb60573f with Priority: HIGH for action security_group_rules [ 1146.820861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c991b17e-e013-4122-96ca-aa291400f826 with Priority: HIGH for action security_group_rules [ 1146.820861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae with Priority: HIGH for action security_group_rules [ 1146.820861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGH for action security_group_rules [ 1146.820861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 with Priority: HIGH for action security_group_rules [ 1146.820861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f37877-f530-4fa7-afd7-080093e64471 with Priority: HIGH for action security_group_rules [ 1146.820861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 with Priority: HIGH for action security_group_rules [ 1146.822012] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.822012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.822012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.822012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.822012] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.822012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.822012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.822012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.822012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.822012] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.823664] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.823886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.823961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.824190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.824275] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2ef9c9c-f8d6-4b45-b624-16d16cab2727',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.825346] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17fd7384-1e1f-4823-baff-e68bca324f40 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.825540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.825540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.825661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.825732] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17fd7384-1e1f-4823-baff-e68bca324f40',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.826716] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.826825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.826884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.827039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.827109] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.827756] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.828973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.828973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.828973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.828973] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dc6b078-d4c5-4e0d-955f-af7c0818a2ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.829433] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0133496a-f61f-45f7-a024-b9b137774b66 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.829722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.829781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.829900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.829974] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0133496a-f61f-45f7-a024-b9b137774b66',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.831580] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.831580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.831580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.831580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.831580] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.835617] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.835617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.835617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.835617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.835617] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af6e748-3c4e-4f35-8470-0d9bbc423daa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.835617] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.835617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.835617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.835879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.835879] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.837930] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.837986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.838066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.838252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.838430] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.839485] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1393cc3-6b9b-4326-8077-4648511fe41e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.839687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.839687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.839916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.839994] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1393cc3-6b9b-4326-8077-4648511fe41e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.840999] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14c7722e-02ea-467c-af4c-394e1f839b23 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.841179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.841179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.841336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.841407] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14c7722e-02ea-467c-af4c-394e1f839b23',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.842063] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1d61d13-44e5-4c83-936b-8a6c378d760a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.842165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.842294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.842415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.842565] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1d61d13-44e5-4c83-936b-8a6c378d760a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.844138] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ba5aef-2625-46a9-b4f6-3654836e0f13 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.844138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.844138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.844138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.844138] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ba5aef-2625-46a9-b4f6-3654836e0f13',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.846073] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57166f3a-68e3-48b8-984a-2376cb60573f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.846073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.846073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.846324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.846324] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57166f3a-68e3-48b8-984a-2376cb60573f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.846894] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c991b17e-e013-4122-96ca-aa291400f826 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.847042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.847089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.847240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.847307] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c991b17e-e013-4122-96ca-aa291400f826',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.847957] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.848075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.848134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.848611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.848611] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc2a59a-272e-4f81-9b52-f6c080a526ae',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.849779] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.849902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.849959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.850176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.850176] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.851269] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.851541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.851678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.852017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.852108] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2546188-fcd4-4401-b075-87ffd0e4a9a9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.853396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f37877-f530-4fa7-afd7-080093e64471 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.853519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.853623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.853833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.853833] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f37877-f530-4fa7-afd7-080093e64471',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.854774] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.854891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.855026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.855093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.855162] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('750167f1-a8ae-4a8e-a9a0-cd5ce2550684',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.177659] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.177896] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.178045] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.178457] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.178765] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.178963] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.179103] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.179372] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.179687] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.179772] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.179920] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.180058] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.180176] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.180303] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.180485] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.180637] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.202295] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.202547] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.202740] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.203010] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.203433] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-2e269fb7-5662-434a-bb83-102c91423bc9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.203678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.203833] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.204272] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.204459] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e269fb7-5662-434a-bb83-102c91423bc9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.324278] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.324454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.324529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.324986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.324986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.325126] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.325237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.325237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.325363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.325497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.325553] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 already deleted. [ 1147.325604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.339040] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.339202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.339202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.339348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.339518] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.339621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.339685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.339855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.339941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.340051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.340143] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.341603] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.341718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.341787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.341941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.342099] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.342193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.342256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.342398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.342490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.342573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.343276] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.349686] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.349817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.349978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.350107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.351955] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.352938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.352938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.352938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.352938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.352938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.352938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.352938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.353504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.353504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.353504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.353504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.353504] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.372131] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.372307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.372389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.372658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.372848] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.372953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.373076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.373251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.373345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.373432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.373519] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.380950] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.381320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.385207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.385364] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2ef9c9c-f8d6-4b45-b624-16d16cab2727 is going to be deleted. [ 1147.388215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.388470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.392313] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.392417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.393222] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.393295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.405268] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.405407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.426656] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.427487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.430229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.430229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.431024] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.431124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.431825] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.431923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.432670] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.432768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.433458] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.433554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.434300] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.434474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.435017] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1147.435551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.435680] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17fd7384-1e1f-4823-baff-e68bca324f40 is going to be deleted. [ 1147.437489] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.437489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.437489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.437687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.440105] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.440208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.440823] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1147.441260] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.441765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.455306] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1147.455818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.455941] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be deleted. [ 1147.456888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.457104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.472033] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.472033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.475688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.475800] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1393cc3-6b9b-4326-8077-4648511fe41e is going to be deleted. [ 1147.476708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.476908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.491987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.492137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.497296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.497420] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ba5aef-2625-46a9-b4f6-3654836e0f13 is going to be deleted. [ 1147.498351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.498566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.530996] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.531204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.532015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.532138] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2546188-fcd4-4401-b075-87ffd0e4a9a9 is going to be deleted. [ 1147.532965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.533184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.572892] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.573114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.583933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.584118] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57166f3a-68e3-48b8-984a-2376cb60573f is going to be deleted. [ 1147.585182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.585535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.600429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.600553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.653876] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.654076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.654650] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1147.655120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.655242] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dc6b078-d4c5-4e0d-955f-af7c0818a2ae is going to be deleted. [ 1147.656105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.656534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.694449] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.694580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.695482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.695601] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c991b17e-e013-4122-96ca-aa291400f826 is going to be deleted. [ 1147.696500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.696721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.709032] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.709261] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.709388] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.709705] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.709884] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.710056] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 2e269fb7-5662-434a-bb83-102c91423bc9 not found, creating... [ 1147.710339] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.710532] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.710846] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.711118] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.711295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.711644] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.711822] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.711892] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.712116] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.712257] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.712401] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 2e269fb7-5662-434a-bb83-102c91423bc9 is going to be created. [ 1147.736072] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.736380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.736547] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.736870] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.737209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.737422] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.765029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.765029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.765029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.765029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f37877-f530-4fa7-afd7-080093e64471 is going to be deleted. [ 1147.765326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.765610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.827324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.827581] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1d61d13-44e5-4c83-936b-8a6c378d760a is going to be deleted. [ 1147.828432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.828647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.839308] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.839440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.845801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.845922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.846035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.846290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.846419] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.846564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.846649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.846820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.846929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.847049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.847224] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.847354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.847424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.847569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.847705] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.847797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.847858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.847993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.848092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.848173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.848285] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.849172] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.849292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.849369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.849524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.849665] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.849761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.849824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.849961] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.850051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.850135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.850277] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.850366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.850426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.850562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.850694] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.850781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.850840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.850969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.851053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.851133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.851213] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.857450] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.863284] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 in Status: SUCCESS [ 1147.863472] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 deletion is rescheduled due to dependency. [ 1147.863588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.877268] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.877399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.877455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.877639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.877784] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.877891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.877940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.878098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.878181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.878313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.878460] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.878562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.878624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.878761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.878896] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.878985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.879070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.879190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.879492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.879492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.879492] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.910028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.910028] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc2a59a-272e-4f81-9b52-f6c080a526ae is going to be deleted. [ 1147.910676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.910902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.911029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.911162] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 750167f1-a8ae-4a8e-a9a0-cd5ce2550684 is going to be deleted. [ 1147.911925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.912188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.931422] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.931551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.980194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.980340] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0133496a-f61f-45f7-a024-b9b137774b66 is going to be deleted. [ 1147.981313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.981536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.024541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.024541] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af6e748-3c4e-4f35-8470-0d9bbc423daa is going to be deleted. [ 1148.024690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.024919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.040337] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.040337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.059198] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.059198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.063057] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.063057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.108085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.108195] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14c7722e-02ea-467c-af4c-394e1f839b23 is going to be deleted. [ 1148.109173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.109421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.109518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.109642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2ef9c9c-f8d6-4b45-b624-16d16cab2727" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.109800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.109963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.110059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.110177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17fd7384-1e1f-4823-baff-e68bca324f40" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.110659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.110818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.114304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.114442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.114585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.114739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.114833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.114948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1393cc3-6b9b-4326-8077-4648511fe41e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.115094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.115240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.115316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.115433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ba5aef-2625-46a9-b4f6-3654836e0f13" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.115564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.115703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.115780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.115886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2546188-fcd4-4401-b075-87ffd0e4a9a9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.116182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.116275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57166f3a-68e3-48b8-984a-2376cb60573f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.116663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.116735] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dc6b078-d4c5-4e0d-955f-af7c0818a2ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.117121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.117193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.117303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c991b17e-e013-4122-96ca-aa291400f826" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.117561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.117867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.117944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.118064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f37877-f530-4fa7-afd7-080093e64471" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.118302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.118462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.118536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.118644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1d61d13-44e5-4c83-936b-8a6c378d760a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.118770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.118907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.118979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.119107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-750167f1-a8ae-4a8e-a9a0-cd5ce2550684" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.119222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.119363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.119450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.119617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc2a59a-272e-4f81-9b52-f6c080a526ae" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.127430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.127559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.127627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.127793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.127917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.128167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0133496a-f61f-45f7-a024-b9b137774b66" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.224261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.224405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.224561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.224706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.224801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.224957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af6e748-3c4e-4f35-8470-0d9bbc423daa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.232507] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1148.232985] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.233119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.233190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.233367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.233453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.233567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14c7722e-02ea-467c-af4c-394e1f839b23" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.353137] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac44685-7555-444d-b1ce-19ece671a825: rpc.has_security_group_logging(os_id): False [ 1148.354268] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f0e8ca4-9613-4991-a992-cf2ef6089b55: rpc.has_security_group_logging(os_id): False [ 1148.360328] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26d43c7c-82c8-4a83-8478-40e297491039: rpc.has_security_group_logging(os_id): False [ 1148.378229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.378428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.378492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.378685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.381712] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e: rpc.has_security_group_logging(os_id): False [ 1148.383477] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.383581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.388508] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.388670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.411502] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.411669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.414210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.414412] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.414515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.414579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.414771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.414853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.415081] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.415160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.415229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.416016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.416016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.416016] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.416016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.416016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.416016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.416016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.416016] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be updated. [ 1148.416946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.417173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.434204] env[70032]: INFO networking_nsxv3.common.synchronization [req-6a8915c3-f363-48eb-8ec8-d8f3526e07d8 req-9045eaba-f73a-4747-9e47-5769e13296cc service nova] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1148.434379] env[70032]: INFO networking_nsxv3.common.synchronization [req-6a8915c3-f363-48eb-8ec8-d8f3526e07d8 req-9045eaba-f73a-4747-9e47-5769e13296cc service nova] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1148.435068] env[70032]: INFO networking_nsxv3.common.synchronization [req-6a8915c3-f363-48eb-8ec8-d8f3526e07d8 req-9045eaba-f73a-4747-9e47-5769e13296cc service nova] Enqueued Resource ID: 2e269fb7-5662-434a-bb83-102c91423bc9 with Priority: HIGHEST for action port [ 1148.435967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.436173] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.436282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.436349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.436508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.436585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.436773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.436871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.436933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.437108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.437187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.437375] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.437458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.437516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.437697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.437729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.437802] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1148.438757] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1148.438894] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1148.438989] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e269fb7-5662-434a-bb83-102c91423bc9 with Priority: HIGHEST for action port [ 1148.439461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.439618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.441701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.441701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.441701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.441701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.441701] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.441701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.442630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.442630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.442630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.442630] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.442630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.442630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.442630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.442630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.442630] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.446451] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e269fb7-5662-434a-bb83-102c91423bc9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.446451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.446576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.446649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.446722] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e269fb7-5662-434a-bb83-102c91423bc9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.464664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.464914] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.465045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.465121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.465418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.465418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.465572] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.465669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.465732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.465876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.465948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.466136] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.466216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.466274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.466421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.466480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.466563] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be updated. [ 1148.468353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.468520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.485857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.486278] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.486464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.486576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.486860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.487036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.487195] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 is going to be updated. [ 1148.490528] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.490599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.490638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.490802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.490939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.499806] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: IN_PROGRESS for 2s [ 1148.507444] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.507444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.507444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.507624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.507652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.528404] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1148.535477] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.535614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.535663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.535859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.535996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.542817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.542972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.543043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.543183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.543341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.546930] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: IN_PROGRESS for 2s [ 1148.554921] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: IN_PROGRESS for 2s [ 1148.949742] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.950091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.950091] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.954560] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e269fb7-5662-434a-bb83-102c91423bc9 with status ACTIVE [ 1148.954602] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.954724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.954782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.954967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.955075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.955229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.955314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.955444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.955510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.955590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.955938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.955938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.955938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.956092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.956177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.956528] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e269fb7-5662-434a-bb83-102c91423bc9 is going to be updated. [ 1148.974391] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.974557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.974619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.974768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.974898] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.975063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.452462] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.955592] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.957058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.957058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.957058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.957058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.957058] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 is going to be created. [ 1149.979419] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.979573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.979644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.979846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.979999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.989170] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: UNINITIALIZED for 2s [ 1150.512230] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 1150.512468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.544280] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1150.544532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.560461] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1150.560677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.567438] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: SUCCESS [ 1150.567698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.747709] env[70032]: INFO networking_nsxv3.common.synchronization [req-af98b907-711d-444e-97fc-f7a3cbfd1cd8 req-c87e88f3-b305-45d5-81a7-3d1b0619056c tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1150.749947] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1150.751503] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.751638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.751716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.751908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.752190] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.752190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.752300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.752368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.752458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.752558] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.254926] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.255322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.255322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.255414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.255489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.255702] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.255820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.255856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.256023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.256101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.257037] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1151.287918] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.288110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.288160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.288441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.288612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.298632] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1151.998047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: SUCCESS [ 1151.998269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.998492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.998702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.998890] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.999035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.999088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.999221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.999337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.999556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.999668] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.502443] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.660984] env[70032]: INFO networking_nsxv3.common.synchronization [req-bd0ba725-58eb-43be-a908-89224463e3d5 req-2e371120-ee97-40b4-88bf-3513d0036796 tempest-ServersAdminNegativeTestJSON-1963466895 tempest-ServersAdminNegativeTestJSON-1963466895-project-member] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1152.661636] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1152.662099] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.662191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.662258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.662465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.662637] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.662729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.662794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.662947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.663048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.663140] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.004593] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd262fda-5bb7-40bc-b4f2-b2cdd0080c60: rpc.has_security_group_logging(os_id): False [ 1153.010317] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.010507] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.010648] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.010898] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.011164] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.011328] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.012173] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.012173] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.012173] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.012173] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.012173] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.012649] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.012649] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.012649] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.012649] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.012823] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.020956] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.021087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.021157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.021321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.021404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.021629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.021724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.021786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.021924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.021997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.022092] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 is going to be created. [ 1153.031562] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.031693] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.031833] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.031999] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-418" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.032399] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-855e8f8c-a415-45cc-83c2-de63f70b5bf4 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.032488] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.032567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.032844] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.032983] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('855e8f8c-a415-45cc-83c2-de63f70b5bf4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.085028] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.085028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.085028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.085028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.085028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.093031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: IN_PROGRESS for 2s [ 1153.166010] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.308220] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1153.308220] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 1153.308220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.535708] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.536028] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.536096] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.536418] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.536722] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.536914] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 855e8f8c-a415-45cc-83c2-de63f70b5bf4 not found, creating... [ 1153.537218] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.537622] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.537622] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.537728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.537842] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.538136] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.538306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.538477] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.538699] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.538842] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.538986] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 855e8f8c-a415-45cc-83c2-de63f70b5bf4 is going to be created. [ 1153.557038] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.557252] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.557394] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.557646] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.558353] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.558635] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.669139] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.171713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.171713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.171713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.172214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.172214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.172214] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be updated. [ 1154.209571] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.209839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.209905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.210204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.210372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.220969] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: IN_PROGRESS for 2s [ 1155.024985] env[70032]: INFO networking_nsxv3.common.synchronization [req-bd0ba725-58eb-43be-a908-89224463e3d5 req-de138a37-34a8-40b1-ac7f-8fe3b4918710 service nova] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_rules [ 1155.025227] env[70032]: INFO networking_nsxv3.common.synchronization [req-bd0ba725-58eb-43be-a908-89224463e3d5 req-de138a37-34a8-40b1-ac7f-8fe3b4918710 service nova] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1155.025338] env[70032]: INFO networking_nsxv3.common.synchronization [req-bd0ba725-58eb-43be-a908-89224463e3d5 req-de138a37-34a8-40b1-ac7f-8fe3b4918710 service nova] Enqueued Resource ID: 855e8f8c-a415-45cc-83c2-de63f70b5bf4 with Priority: HIGHEST for action port [ 1155.025560] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_rules [ 1155.025685] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1155.025778] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 855e8f8c-a415-45cc-83c2-de63f70b5bf4 with Priority: HIGHEST for action port [ 1155.026313] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.026439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.026508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.026710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.026794] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.027760] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.027832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.028026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-855e8f8c-a415-45cc-83c2-de63f70b5bf4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.028126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.028191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.028576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.028576] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('855e8f8c-a415-45cc-83c2-de63f70b5bf4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.104431] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: SUCCESS [ 1155.104655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.465104] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.466626] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.466626] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.466626] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.466626] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.466836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.467405] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.467405] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.467405] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.467590] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.467683] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.467793] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.467905] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.468028] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.468142] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.468275] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.495136] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.495336] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1155.495488] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.495693] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-307" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.496043] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.496234] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.496392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.496689] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.496830] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6c601a8-43f4-4a1a-80fa-28f29692dfa1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.529990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.529990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.532300] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 855e8f8c-a415-45cc-83c2-de63f70b5bf4 with status ACTIVE [ 1155.532589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.532713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.532713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.532885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.532975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.533156] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.533293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.533349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.533479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.533566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.533748] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.533840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.533896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.534052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.534143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.534256] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 855e8f8c-a415-45cc-83c2-de63f70b5bf4 is going to be updated. [ 1155.554957] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.554957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.554957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.555190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.555321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.555499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-855e8f8c-a415-45cc-83c2-de63f70b5bf4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.000081] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.000374] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.000539] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.000849] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.001448] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.001825] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.002009] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.002137] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.002368] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.002513] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.002832] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.003009] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.003138] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.003350] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.003549] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.003755] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 is going to be updated. [ 1156.022915] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.023124] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.023267] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.023493] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.023698] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.023927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.236774] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1156.237231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.237231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.237485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.237605] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.237724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.237791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.237942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.238037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.238134] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.742178] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.773630] env[70032]: INFO networking_nsxv3.common.synchronization [req-0ba170a3-898d-4c0e-a633-7be5b5fa41a4 req-dd4d28f3-1d28-44d2-a759-86f5dd511690 service nova] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_rules [ 1156.773630] env[70032]: INFO networking_nsxv3.common.synchronization [req-0ba170a3-898d-4c0e-a633-7be5b5fa41a4 req-dd4d28f3-1d28-44d2-a759-86f5dd511690 service nova] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1156.773630] env[70032]: INFO networking_nsxv3.common.synchronization [req-0ba170a3-898d-4c0e-a633-7be5b5fa41a4 req-dd4d28f3-1d28-44d2-a759-86f5dd511690 service nova] Enqueued Resource ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 with Priority: HIGHEST for action port [ 1156.773630] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_rules [ 1156.773630] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1156.773630] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 with Priority: HIGHEST for action port [ 1156.773630] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.774193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.774417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.774695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.774853] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.776954] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.776954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.776954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.776954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.776954] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.776954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.776954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.777315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.777477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.777702] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.778641] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.778900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.779090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.779324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.780575] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6c601a8-43f4-4a1a-80fa-28f29692dfa1',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.244533] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.280746] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.281638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.281991] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.284591] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6c601a8-43f4-4a1a-80fa-28f29692dfa1 with status ACTIVE [ 1157.284783] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.285064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.285064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.285365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.285365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.285533] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.285651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.285850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.286183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.286269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.286530] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.286811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.286811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.286993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.287188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.287299] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6c601a8-43f4-4a1a-80fa-28f29692dfa1 is going to be updated. [ 1157.307713] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.307835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.307919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.308132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.308272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.308487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6c601a8-43f4-4a1a-80fa-28f29692dfa1" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.747116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.747330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.747398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.747547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.747637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.747738] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be updated. [ 1157.785027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.785027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.785027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.785027] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.785202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.787175] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.796476] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: IN_PROGRESS for 2s [ 1158.290528] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.290528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.290528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.290528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.290528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.290528] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be updated. [ 1158.317052] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.317207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.317278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.317619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.317619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.326068] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 1159.806259] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1159.806572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.806813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.807368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.807445] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.807570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.807675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.807907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.808047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.808177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.808301] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.310805] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.311031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.311108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.311322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.311552] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.311668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.311733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.311887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.311977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.312075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.312232] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.312323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.312381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.312519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.312654] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.312754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.312812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.312946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.313031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.313113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.313200] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.334386] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 1160.334610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.334761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.335056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.335242] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.335355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.335462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.335571] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.335671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.335759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.335846] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.815796] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e: rpc.has_security_group_logging(os_id): False [ 1160.834801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.834973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.835028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.835250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.835344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.835560] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.835664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.835724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.835883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.835945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.836160] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.836281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.836310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.836448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.836519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.836695] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.836786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.836844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.836977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.837063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.837148] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be updated. [ 1160.838335] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.838464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.838529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.838660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.838809] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.838903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.838948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.839099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.839173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.839253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.839397] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.839484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.839551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.839690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.839824] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.839912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.839971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.840128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.840196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.840262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.840352] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.914042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.915025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.915025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.915025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.915025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.930123] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: IN_PROGRESS for 2s [ 1161.345227] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bccc08ea-f041-453a-b54a-615933f6cecf: rpc.has_security_group_logging(os_id): False [ 1161.364871] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.365049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.365134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.365348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.383807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.384082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.384197] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.384264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.384450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.384535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.384734] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.384833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.384895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.385058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.385138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.385317] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.385414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.385480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.385629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.385707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.385795] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be updated. [ 1161.448841] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.449034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.449078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.449264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.449404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.463521] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 1161.773402] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.773616] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1162.946425] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1162.946425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.478788] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 1163.478788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.775401] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1166.775401] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1166.834282] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf88f7e1-9655-45a3-87a2-0505d3a36cd8 req-bbcf45a1-15e8-4603-9e16-48bb00201f2a tempest-ServersTestBootFromVolume-1935082994 tempest-ServersTestBootFromVolume-1935082994-project-member] Enqueued Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_members [ 1166.835342] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_members [ 1166.835949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.836235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.836391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.836784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.837038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.837200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.837269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.837537] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.837729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.837938] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.232363] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.232492] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-683" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.232679] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-683" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.233288] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-683" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.234042] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.234042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.234165] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.234454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.234684] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.234976] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.235293] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.235361] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.235514] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.235692] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.235870] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.236475] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.255746] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.256040] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1167.256270] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.256556] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-683" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.257055] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7ab81a11-0310-4033-88b4-04e3ec0755a0 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.257330] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.257622] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.258761] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.259035] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ab81a11-0310-4033-88b4-04e3ec0755a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.341826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.342033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.342091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.342333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.342429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.342659] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.342768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.342826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.343016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.343101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.343192] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 already deleted. [ 1167.343273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.762093] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.766441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.766441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.766441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.766441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.766441] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7ab81a11-0310-4033-88b4-04e3ec0755a0 not found, creating... [ 1167.766441] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.766441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.766824] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.766824] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.767496] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.767496] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.767650] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.767788] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.771333] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.771500] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.771660] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7ab81a11-0310-4033-88b4-04e3ec0755a0 is going to be created. [ 1167.793055] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.793464] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.793464] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.793763] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.794055] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.794911] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.793181] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf88f7e1-9655-45a3-87a2-0505d3a36cd8 req-5eaa652e-30c7-44b8-b6a5-90abfecbee3d service nova] Enqueued Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_rules [ 1168.793181] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf88f7e1-9655-45a3-87a2-0505d3a36cd8 req-5eaa652e-30c7-44b8-b6a5-90abfecbee3d service nova] Enqueued Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_members [ 1168.793181] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf88f7e1-9655-45a3-87a2-0505d3a36cd8 req-5eaa652e-30c7-44b8-b6a5-90abfecbee3d service nova] Enqueued Resource ID: 7ab81a11-0310-4033-88b4-04e3ec0755a0 with Priority: HIGHEST for action port [ 1168.793181] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_rules [ 1168.793181] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_members [ 1168.793181] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ab81a11-0310-4033-88b4-04e3ec0755a0 with Priority: HIGHEST for action port [ 1168.797021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.797021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.797021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.797021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.797021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.797021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.801813] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ab81a11-0310-4033-88b4-04e3ec0755a0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.801967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.801967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.802117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.802280] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ab81a11-0310-4033-88b4-04e3ec0755a0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.252726] env[70032]: INFO networking_nsxv3.common.synchronization [req-ba2e0937-1925-40e1-8752-50582ad01407 req-4399af28-93ae-4235-8e93-0c47550cf3c5 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1169.252726] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1169.252726] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.252947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.252947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.253336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.253460] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.253567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.253636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.254356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.254356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.254356] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.304540] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ab81a11-0310-4033-88b4-04e3ec0755a0 with status ACTIVE [ 1169.304913] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.305088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.305164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.305746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.305876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.306112] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.306239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.306317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.306507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.306828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.306828] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.306943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.306943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.307125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.307216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.307290] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ab81a11-0310-4033-88b4-04e3ec0755a0 is going to be updated. [ 1169.308475] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.309651] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.309763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.330301] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.330721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.330721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.330921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.330984] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.331658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ab81a11-0310-4033-88b4-04e3ec0755a0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.643168] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.643397] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.643599] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.643890] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.644179] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.644355] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.644535] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.644775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.644934] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.645159] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.645275] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.645430] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.645590] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.645714] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.645864] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.646048] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.664998] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.665204] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1169.665494] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.665740] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.666084] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-48866895-3414-4f81-80d1-fbdecb49ee39 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.666268] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.666497] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.666889] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.667053] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48866895-3414-4f81-80d1-fbdecb49ee39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.757339] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.811364] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.170067] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.170067] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.170285] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.170412] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.170609] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.170777] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 48866895-3414-4f81-80d1-fbdecb49ee39 not found, creating... [ 1170.171124] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.171310] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.171449] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.171689] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.171850] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.172178] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.172352] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.172490] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.172729] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.172889] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.173047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 48866895-3414-4f81-80d1-fbdecb49ee39 is going to be created. [ 1170.192648] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.192869] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.193024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.193306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.193574] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.193857] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.263104] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.313608] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.313916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.313916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.314066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.314144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.314254] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 is going to be created. [ 1170.342706] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.342912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.342981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.343257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.343506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.355629] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 in Status: UNINITIALIZED for 2s [ 1170.604118] env[70032]: INFO networking_nsxv3.common.synchronization [req-15adabee-3a56-483b-8e99-9d13e2c33250 req-57f8eedf-c9d1-4f89-bf08-4d7ea7ef9730 tempest-ServersWithFlavorSwapResizeTest-1417678224 tempest-ServersWithFlavorSwapResizeTest-1417678224-project-member] Enqueued Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_members [ 1170.604118] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGHEST for action security_group_members [ 1170.604118] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.604118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.604118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.604118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.604383] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.604428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.604481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.604643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.604728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.604818] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.766558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.766558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.766558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.766558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.766558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.766558] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 is going to be updated. [ 1170.794200] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.794464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.794558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.794862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.795070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.804990] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: IN_PROGRESS for 2s [ 1171.000816] env[70032]: INFO networking_nsxv3.common.synchronization [req-ba2e0937-1925-40e1-8752-50582ad01407 req-27f4f253-99bc-4aec-8756-c8c4f0ced6cf service nova] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1171.001072] env[70032]: INFO networking_nsxv3.common.synchronization [req-ba2e0937-1925-40e1-8752-50582ad01407 req-27f4f253-99bc-4aec-8756-c8c4f0ced6cf service nova] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1171.001190] env[70032]: INFO networking_nsxv3.common.synchronization [req-ba2e0937-1925-40e1-8752-50582ad01407 req-27f4f253-99bc-4aec-8756-c8c4f0ced6cf service nova] Enqueued Resource ID: 48866895-3414-4f81-80d1-fbdecb49ee39 with Priority: HIGHEST for action port [ 1171.001399] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_rules [ 1171.001526] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1171.001625] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48866895-3414-4f81-80d1-fbdecb49ee39 with Priority: HIGHEST for action port [ 1171.002796] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.002929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.003017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.004828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.004867] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.006288] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.006539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.006761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-48866895-3414-4f81-80d1-fbdecb49ee39 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.006872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.006938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.007128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.007207] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48866895-3414-4f81-80d1-fbdecb49ee39',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.108257] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.108410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.108495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.108781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.132676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.133041] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.133211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.133306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.133574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.133695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.133818] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc is going to be updated. [ 1171.162459] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.162695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.162803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.163107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.163309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.175329] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc in Status: IN_PROGRESS for 2s [ 1171.507480] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.507623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.509090] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48866895-3414-4f81-80d1-fbdecb49ee39 with status ACTIVE [ 1171.509281] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.509415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.509497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.509771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.509865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.510145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.510256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.510345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.510554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.510603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.510759] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.510858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.510922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.511069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.511142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.511228] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48866895-3414-4f81-80d1-fbdecb49ee39 is going to be updated. [ 1171.532282] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.532505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.532614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.532863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.533075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.533249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48866895-3414-4f81-80d1-fbdecb49ee39" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.064731] env[70032]: INFO networking_nsxv3.common.synchronization [req-674cbd0f-fce1-4237-aa51-9060c781ff09 req-b9e0136d-0363-4695-a365-c35b99faff11 tempest-ServersAdminNegativeTestJSON-1963466895 tempest-ServersAdminNegativeTestJSON-1963466895-project-member] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1172.068567] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1172.068567] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.068567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.068567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.068567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.068567] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.068567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.068567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.068567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.068567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.068567] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.365972] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 in Status: SUCCESS [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.368695] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.368695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.368695] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.574830] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.816266] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: SUCCESS [ 1172.816266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.816266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.816266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.816266] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.816266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.816266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.816266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.816266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.816266] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.872103] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.077035] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.185747] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc in Status: SUCCESS [ 1173.185954] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc deletion is rescheduled due to dependency. [ 1173.186082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.319680] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.374200] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7b2bda6-e2c6-4891-b6fc-b19e87eed978: rpc.has_security_group_logging(os_id): False [ 1173.394638] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.394798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.394965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.395970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.395970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.395970] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.395970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.396466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.396466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.396576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.396757] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 is going to be created. [ 1173.452409] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.452409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.452409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.452409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.452409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.462194] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 in Status: IN_PROGRESS for 2s [ 1173.579701] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.579900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.580221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.580501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.580627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.580761] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be updated. [ 1173.620801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.620956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.621126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.621356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.621503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.631668] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: IN_PROGRESS for 2s [ 1173.825511] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.331764] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.331764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.331764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.331764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.331764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.331764] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 is going to be updated. [ 1174.364877] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.365114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.365191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.365414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.365557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.374168] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: IN_PROGRESS for 2s [ 1175.476028] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 in Status: SUCCESS [ 1175.476028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.643248] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1175.643543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.384419] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: SUCCESS [ 1176.384650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.385263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.385499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.385837] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.386475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.386475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.386475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.386475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.386475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.386669] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.889036] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.067534] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.067534] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1177.392172] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec6619bd-9b1f-429e-957b-14f3db7e57f0: rpc.has_security_group_logging(os_id): False [ 1177.408609] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.409042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.409118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.409327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.427455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.427773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.427978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.428060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.428260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.428345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.428435] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 is going to be updated. [ 1177.482814] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.482996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.483136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.483362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.483511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.496406] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: IN_PROGRESS for 2s [ 1179.517836] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: SUCCESS [ 1179.518224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.205704] env[70032]: INFO networking_nsxv3.common.synchronization [req-d6e1ae8d-f5b9-4333-8880-f5958f50fb81 req-52b7166d-279d-4db1-be3e-593d195d2ca4 tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1181.206272] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1181.206627] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.206894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.207010] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.207790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.208796] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.208933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.209122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.209523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.209625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.209729] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.712189] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.712405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.712405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.712636] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.735714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.735973] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.736118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.736161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.736406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.736510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.736552] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1181.761903] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.762083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.762141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.762330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.762467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.770018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1182.636538] env[70032]: INFO networking_nsxv3.common.synchronization [req-7b04f42a-c49c-409d-87b5-9777e3a0ae3d req-07e59d0c-0965-4fcd-abc0-557db2c5368d tempest-ServersAdminNegativeTestJSON-1963466895 tempest-ServersAdminNegativeTestJSON-1963466895-project-member] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1182.637198] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGHEST for action security_group_members [ 1182.637406] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.637531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.637599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.637800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.637952] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.638063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.638151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.638530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.638530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.638530] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.941167] env[70032]: INFO networking_nsxv3.common.synchronization [None req-dce8fb32-3e07-411e-afa2-31a2c9e27110 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1182.941167] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1182.941167] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.941167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.941167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.941167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.941167] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.941673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.941836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.942090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.942260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.942430] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.141599] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.141712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.141749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.142589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.142589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.142589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.142589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.142589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.142589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.142589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.143073] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be updated. [ 1183.170462] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.170462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.170462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.170462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.170462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.183452] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: IN_PROGRESS for 2s [ 1183.445281] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.445488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.445546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.445773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.445841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.446067] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.446212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.446278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.446424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.446535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.446579] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be deleted. [ 1183.485475] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.485627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.485627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.485762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.485867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.485944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.778962] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1183.779251] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 deletion is rescheduled due to dependency. [ 1183.779354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.190870] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e in Status: SUCCESS [ 1185.191151] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e deletion is rescheduled due to dependency. [ 1185.191226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.358505] env[70032]: INFO networking_nsxv3.common.synchronization [req-74248142-0d3f-489e-899e-ac048d1b5877 req-bed7cc7a-dd89-46d3-b692-86cdcf212d04 tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1185.359210] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1185.359500] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.359629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.359698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.360061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.360236] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.360452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.360452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.360580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.360658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.360751] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.862971] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.863150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.863226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.863444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.863536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.863731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.863831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.863896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.864056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.864135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.864222] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1185.889180] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.891422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.891422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.891422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.891422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.894394] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.894394] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.894394] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.894625] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.894797] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.894952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.895089] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.895309] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.897545] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.897545] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.897545] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.897545] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.897545] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.897545] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.897545] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.897545] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.911717] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1185.942767] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.942954] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1185.943114] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.943309] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-912" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.943634] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.943815] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.943974] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.944389] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.944537] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.447605] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.447947] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.448579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.448579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.448663] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.448823] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d not found, creating... [ 1186.449199] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.449321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.449447] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.449687] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.450255] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.452336] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.452609] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.452905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.453040] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.453237] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.453477] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d is going to be created. [ 1186.474630] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.474859] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.474989] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.475288] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.475526] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.475747] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.761092] env[70032]: INFO networking_nsxv3.common.synchronization [None req-81015fa3-7afe-4678-b29d-1d8a742f9c94 None None] Enqueued Resource ID: 8556338b-ea33-438a-ac71-a3fffa4a916b with Priority: HIGHEST for action port [ 1186.761092] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8556338b-ea33-438a-ac71-a3fffa4a916b with Priority: HIGHEST for action port [ 1186.761092] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-8556338b-ea33-438a-ac71-a3fffa4a916b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.761092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8556338b-ea33-438a-ac71-a3fffa4a916b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.761092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8556338b-ea33-438a-ac71-a3fffa4a916b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.761429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8556338b-ea33-438a-ac71-a3fffa4a916b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.761429] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8556338b-ea33-438a-ac71-a3fffa4a916b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.264214] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8556338b-ea33-438a-ac71-a3fffa4a916b [ 1187.264214] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.264214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.264214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.264214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.264214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.264214] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8556338b-ea33-438a-ac71-a3fffa4a916b already deleted. [ 1187.264214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8556338b-ea33-438a-ac71-a3fffa4a916b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.489930] env[70032]: INFO networking_nsxv3.common.synchronization [req-74248142-0d3f-489e-899e-ac048d1b5877 req-61ed967f-8f98-4ae0-a96d-18a530e1c514 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 1187.490148] env[70032]: INFO networking_nsxv3.common.synchronization [req-74248142-0d3f-489e-899e-ac048d1b5877 req-61ed967f-8f98-4ae0-a96d-18a530e1c514 service nova] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1187.490355] env[70032]: INFO networking_nsxv3.common.synchronization [req-74248142-0d3f-489e-899e-ac048d1b5877 req-61ed967f-8f98-4ae0-a96d-18a530e1c514 service nova] Enqueued Resource ID: 79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d with Priority: HIGHEST for action port [ 1187.490479] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_rules [ 1187.490605] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1187.490700] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d with Priority: HIGHEST for action port [ 1187.492966] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.492966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.492966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.492966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.492966] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.492966] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.492966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.493521] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.493521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.493521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.493521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.493521] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.520551] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.520792] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.520950] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.521324] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.521920] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.522123] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.522253] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.522493] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.522649] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.522862] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.522994] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.523109] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.523222] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.523336] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.523446] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.523584] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.541672] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.541844] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.542048] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.542236] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.542545] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-3ffbca23-4842-4289-b341-c21a5f92364b taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.542723] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.542847] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.543181] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.543372] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ffbca23-4842-4289-b341-c21a5f92364b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.920644] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1187.920819] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 1187.920935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.921136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.921383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.921571] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.921692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.921754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.921904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.921990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.922096] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.995817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.995966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.998772] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d with status ACTIVE [ 1187.999067] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.999199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.999269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.999609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.999646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.999816] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.999915] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.999978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.000159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.000257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.000454] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.000552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.000615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.000756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.000832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.000936] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d is going to be updated. [ 1188.020417] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.020564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.020605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.020802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.020933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.021138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79efd0cf-5fd7-4b1b-a844-3bc8e0aca38d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.047241] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.047476] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.047605] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.047868] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.048036] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.048208] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 3ffbca23-4842-4289-b341-c21a5f92364b not found, creating... [ 1188.048477] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.048639] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.048759] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.049014] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.049164] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.049444] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.049603] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.049726] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.049938] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.051154] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.051342] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 3ffbca23-4842-4289-b341-c21a5f92364b is going to be created. [ 1188.069821] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.070105] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.070245] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.070511] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.071040] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.071040] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.424597] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.909363] env[70032]: INFO networking_nsxv3.common.synchronization [req-7aeb7406-bc5d-4f0f-b1cb-d6ef1deb99be req-e994ece3-8efe-49be-8f24-086134bb13d7 service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1188.909825] env[70032]: INFO networking_nsxv3.common.synchronization [req-7aeb7406-bc5d-4f0f-b1cb-d6ef1deb99be req-e994ece3-8efe-49be-8f24-086134bb13d7 service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1188.909825] env[70032]: INFO networking_nsxv3.common.synchronization [req-7aeb7406-bc5d-4f0f-b1cb-d6ef1deb99be req-e994ece3-8efe-49be-8f24-086134bb13d7 service nova] Enqueued Resource ID: 3ffbca23-4842-4289-b341-c21a5f92364b with Priority: HIGHEST for action port [ 1188.910163] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1188.910300] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1188.910398] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffbca23-4842-4289-b341-c21a5f92364b with Priority: HIGHEST for action port [ 1188.910673] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.910795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.910851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.911062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.911177] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.913504] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.913616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.913679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.913848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.913991] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.916953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.917053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.917198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.917286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.917541] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.921557] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ffbca23-4842-4289-b341-c21a5f92364b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.921557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.921557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.921557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.921557] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ffbca23-4842-4289-b341-c21a5f92364b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.927142] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.421495] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.426020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.426020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ffbca23-4842-4289-b341-c21a5f92364b with status ACTIVE [ 1189.426020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.426020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.426020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.426020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.426720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.426720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.426720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.426720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.426720] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ffbca23-4842-4289-b341-c21a5f92364b is going to be updated. [ 1189.430093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.430268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.430340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.430503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.430592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.430685] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1189.449078] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.449235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.449305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.449601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.449635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.449782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.464045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.464277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.464400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.464712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.464935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.473563] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1189.924712] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.302139] env[70032]: INFO networking_nsxv3.common.synchronization [req-0425df88-c2ef-4fa5-9f55-768c0870e42d req-7c1a1d68-0ba4-4b8e-8b1e-054fb7a6d2e7 tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1190.302671] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1190.302990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.303134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.303199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.303418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.303520] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.303612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.303665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.304363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.304363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.304363] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.363383] env[70032]: INFO networking_nsxv3.common.synchronization [req-68bba2bd-121b-49dd-9742-928b4c737b71 req-326c4580-f137-4ccc-86bf-20130293f651 tempest-ServersNegativeTestJSON-1561012911 tempest-ServersNegativeTestJSON-1561012911-project-member] Enqueued Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1190.363893] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccc08ea-f041-453a-b54a-615933f6cecf with Priority: HIGHEST for action security_group_members [ 1190.364226] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-bccc08ea-f041-453a-b54a-615933f6cecf taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.364357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.364425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.364620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.364773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.364875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.364939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.365105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.365190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.365284] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bccc08ea-f041-453a-b54a-615933f6cecf',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.427498] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.427716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.427826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.428178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.428325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.428483] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be created. [ 1190.450655] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.450816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.450866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.451080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.451237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.460338] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: UNINITIALIZED for 2s [ 1190.807272] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.807482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.807561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.808651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.808651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.808651] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.808651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.808651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.808651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.808651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.809223] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be updated. [ 1190.850102] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.850252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.850321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.850521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.850657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.859647] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: IN_PROGRESS for 2s [ 1190.867197] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.867348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.867420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.867596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.867687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.867875] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.867974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.868053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.868220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.868300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.868386] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf is going to be updated. [ 1190.892561] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.892751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.892883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.893048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.893338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.900847] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: IN_PROGRESS for 2s [ 1191.484588] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1191.484884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.485257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.485257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.487049] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.487049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.487049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.487049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.487049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.487049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.487049] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.988978] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.989180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.989255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.989487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.989667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.989790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.989874] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.989966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.990067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.990159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.990316] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.990401] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.990475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.990614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.990757] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.990843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.990893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.991161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.991236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.991277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.991354] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.469910] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.472066] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.472066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.472066] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.494841] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac44685-7555-444d-b1ce-19ece671a825: rpc.has_security_group_logging(os_id): False [ 1192.510879] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.511075] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.511377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.511473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.511593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.511818] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.511949] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.512049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.512268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.512370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.512633] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.512743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.512808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.512972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.513079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.513382] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.513523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.513597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.513737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.513812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.513900] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1192.575813] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.575978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.575978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.576286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.576384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.590065] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1192.869109] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 1192.869267] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 deletion is rescheduled due to dependency. [ 1192.869398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.909015] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bccc08ea-f041-453a-b54a-615933f6cecf in Status: SUCCESS [ 1192.909374] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bccc08ea-f041-453a-b54a-615933f6cecf deletion is rescheduled due to dependency. [ 1192.909374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bccc08ea-f041-453a-b54a-615933f6cecf" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.973977] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.974195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.974283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.974446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.974711] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.974711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.974870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.974912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.974981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.975082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.975234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.975322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.975379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.975517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.975646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.975739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.975821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.975918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.976060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.976196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.976288] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.024022] env[70032]: INFO networking_nsxv3.common.synchronization [None req-dc58c2c3-b82f-41b8-9917-a62b5371cdb0 None None] Enqueued Resource ID: be9e770c-0170-4719-b6e4-c8113b8e5d8b with Priority: HIGHEST for action port [ 1193.024022] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9e770c-0170-4719-b6e4-c8113b8e5d8b with Priority: HIGHEST for action port [ 1193.024022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-be9e770c-0170-4719-b6e4-c8113b8e5d8b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.024022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be9e770c-0170-4719-b6e4-c8113b8e5d8b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.024022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be9e770c-0170-4719-b6e4-c8113b8e5d8b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.024260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be9e770c-0170-4719-b6e4-c8113b8e5d8b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.024260] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be9e770c-0170-4719-b6e4-c8113b8e5d8b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.368573] env[70032]: INFO networking_nsxv3.common.synchronization [req-78dc5d04-3ba9-4da8-8b2d-fc0597a0724a req-3889d959-589a-4411-80c6-ec0482774eaf tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1193.368573] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1193.368847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.368992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.369067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.369272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.369419] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.369517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.369579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.369721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.369805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.369932] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.479076] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d880077d-b1e8-47fa-bc09-7da9308456b0: rpc.has_security_group_logging(os_id): False [ 1193.498292] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.498292] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.498292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.498895] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.498895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.498895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.498895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.498895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.499072] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.499430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.499500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.499653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.499744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.499834] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be created. [ 1193.528746] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be9e770c-0170-4719-b6e4-c8113b8e5d8b [ 1193.529018] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.529162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.529233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.529548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.529618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.529732] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be9e770c-0170-4719-b6e4-c8113b8e5d8b already deleted. [ 1193.529831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be9e770c-0170-4719-b6e4-c8113b8e5d8b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.557107] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.557263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.557339] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.557555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.557732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.570614] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1193.785160] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.786173] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.786256] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.786543] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.787813] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.787813] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.787813] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.787813] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.787813] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.787813] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1193.788088] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.788088] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.788196] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.788285] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1193.788398] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.788539] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.806279] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.806459] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1193.806602] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.806791] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-429" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.807686] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.807937] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.808079] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.808409] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.808553] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6032515-e993-47fa-aa73-ca4b1bb1eb5c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.872476] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.872599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.872642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.872832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.872924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.873127] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.873228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.873280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.873433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.873746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.873746] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be updated. [ 1193.899471] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.899625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.899625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.899815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.899958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.908131] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: IN_PROGRESS for 2s [ 1194.311459] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.311769] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.311867] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.312383] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.312383] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.312529] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port c6032515-e993-47fa-aa73-ca4b1bb1eb5c not found, creating... [ 1194.312790] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.312970] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.313097] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.313306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.313443] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.313738] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.313897] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.314041] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.314309] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.314395] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.314545] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: c6032515-e993-47fa-aa73-ca4b1bb1eb5c is going to be created. [ 1194.333762] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.333986] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.334132] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.334430] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.334738] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.334981] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.604973] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1194.604973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.080475] env[70032]: INFO networking_nsxv3.common.synchronization [req-78dc5d04-3ba9-4da8-8b2d-fc0597a0724a req-2fa3c7ab-171c-4a0e-8974-207af15bead8 service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 1195.080475] env[70032]: INFO networking_nsxv3.common.synchronization [req-78dc5d04-3ba9-4da8-8b2d-fc0597a0724a req-2fa3c7ab-171c-4a0e-8974-207af15bead8 service nova] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1195.080475] env[70032]: INFO networking_nsxv3.common.synchronization [req-78dc5d04-3ba9-4da8-8b2d-fc0597a0724a req-2fa3c7ab-171c-4a0e-8974-207af15bead8 service nova] Enqueued Resource ID: c6032515-e993-47fa-aa73-ca4b1bb1eb5c with Priority: HIGHEST for action port [ 1195.080475] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_rules [ 1195.080475] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1195.080475] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6032515-e993-47fa-aa73-ca4b1bb1eb5c with Priority: HIGHEST for action port [ 1195.080475] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.080475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.081315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.081667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.081979] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.083058] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.083375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.083826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.084873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.084873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.084873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.084873] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6032515-e993-47fa-aa73-ca4b1bb1eb5c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.544320] env[70032]: INFO networking_nsxv3.common.synchronization [None req-dd8c6500-ccb1-4992-9e89-531ff36a7a0c None None] Enqueued Resource ID: fd24c564-b7e7-47de-b450-2a17ee5d9376 with Priority: HIGHEST for action port [ 1195.544845] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd24c564-b7e7-47de-b450-2a17ee5d9376 with Priority: HIGHEST for action port [ 1195.545163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd24c564-b7e7-47de-b450-2a17ee5d9376 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.545395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd24c564-b7e7-47de-b450-2a17ee5d9376" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.545395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd24c564-b7e7-47de-b450-2a17ee5d9376" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.545593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd24c564-b7e7-47de-b450-2a17ee5d9376" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.545679] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd24c564-b7e7-47de-b450-2a17ee5d9376',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.586782] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6032515-e993-47fa-aa73-ca4b1bb1eb5c with status ACTIVE [ 1195.586922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.587063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.587135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.587334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.587495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.587597] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.587695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.587752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.587895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.587998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.588159] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.588243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.588463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.588463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.588576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.588576] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6032515-e993-47fa-aa73-ca4b1bb1eb5c is going to be updated. [ 1195.589702] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.589795] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.597333] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1195.597529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.629507] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.629507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.630272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.630272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.630272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.630272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6032515-e993-47fa-aa73-ca4b1bb1eb5c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.704753] env[70032]: INFO networking_nsxv3.common.synchronization [req-40ca8720-9890-4dec-a8ca-d98a2281c989 req-99644601-ade9-4b47-93d8-d6270a8af183 tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1195.705724] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1195.708439] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.708627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.708665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.708844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.709090] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.709210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.709277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.709772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.709891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.710022] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.917377] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 1195.917550] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 deletion is rescheduled due to dependency. [ 1195.917665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.917830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.918079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.918276] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.918396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.918460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.918616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.918699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.918793] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.024681] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.024897] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.025037] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.025317] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.025578] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.025736] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.025928] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.026084] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.026238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.026453] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.026569] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.026681] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.026793] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.026931] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.027070] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.027212] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.044478] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.044636] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1196.044778] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.044946] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.045255] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.045420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.045543] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.045843] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.045992] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0918d00e-2f14-47bf-8e8c-e4f9b7d3018f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.048060] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd24c564-b7e7-47de-b450-2a17ee5d9376 [ 1196.048060] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.048060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.048060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.048060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.048060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.048060] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd24c564-b7e7-47de-b450-2a17ee5d9376 already deleted. [ 1196.048060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd24c564-b7e7-47de-b450-2a17ee5d9376" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.212097] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.212264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.212338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.212550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.212644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.212834] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.212930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.212995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.213153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.213320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.213467] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1196.254331] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.254484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.254582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.254771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.254987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.263335] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1196.421603] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.548505] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.548704] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.548835] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.549278] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.549450] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.549616] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 0918d00e-2f14-47bf-8e8c-e4f9b7d3018f not found, creating... [ 1196.549890] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.550062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.550186] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.550413] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.550553] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.550832] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.550990] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.551148] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.551387] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.551521] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.551662] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 0918d00e-2f14-47bf-8e8c-e4f9b7d3018f is going to be created. [ 1196.570125] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.570343] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.570474] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.570744] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.570983] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.571683] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.924621] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.266176] env[70032]: INFO networking_nsxv3.common.synchronization [req-40ca8720-9890-4dec-a8ca-d98a2281c989 req-1d48314a-e4d0-45d5-a47b-a67e216ef0e4 service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 1197.266176] env[70032]: INFO networking_nsxv3.common.synchronization [req-40ca8720-9890-4dec-a8ca-d98a2281c989 req-1d48314a-e4d0-45d5-a47b-a67e216ef0e4 service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1197.266353] env[70032]: INFO networking_nsxv3.common.synchronization [req-40ca8720-9890-4dec-a8ca-d98a2281c989 req-1d48314a-e4d0-45d5-a47b-a67e216ef0e4 service nova] Enqueued Resource ID: 0918d00e-2f14-47bf-8e8c-e4f9b7d3018f with Priority: HIGHEST for action port [ 1197.266898] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 1197.266898] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1197.266898] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0918d00e-2f14-47bf-8e8c-e4f9b7d3018f with Priority: HIGHEST for action port [ 1197.267331] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.267458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.267549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.267724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.267803] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.268998] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.268998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.268998] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.269155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.269155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.269277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.269320] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0918d00e-2f14-47bf-8e8c-e4f9b7d3018f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.426705] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.426899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.426956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.427163] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.427258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.427357] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be updated. [ 1197.458798] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.459048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.459124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.459941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.459941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.467204] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: IN_PROGRESS for 2s [ 1197.771810] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.771924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.773210] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0918d00e-2f14-47bf-8e8c-e4f9b7d3018f with status ACTIVE [ 1197.773384] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.773522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.773590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.773796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.773892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.774127] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.774239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.774303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.774461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.774542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.774721] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.774824] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.774886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.775036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.775135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.775222] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0918d00e-2f14-47bf-8e8c-e4f9b7d3018f is going to be updated. [ 1197.793877] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.793877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.794044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.794518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.794518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.794518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0918d00e-2f14-47bf-8e8c-e4f9b7d3018f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.273499] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1198.273499] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 deletion is rescheduled due to dependency. [ 1198.273499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.273499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.273499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.274396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.274396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.274396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.274396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.274396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.274396] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.776472] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.280613] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.475868] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 1199.476149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.476317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.476632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.476833] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.477064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.477064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.477210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.477293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.477378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.477507] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.695934] env[70032]: INFO networking_nsxv3.common.synchronization [req-d6b09ddb-0f56-4309-818a-28e59e57c1e3 req-1793b641-8db0-4738-a76d-254f99ba85e6 tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1199.696545] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1199.696745] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.696864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.696919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.697216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.697371] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.697471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.697534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.697692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.697765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.697858] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.781859] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.782137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.782137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.782297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.782346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.782438] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1199.812391] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.812891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.813106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.814816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.814816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.821206] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1199.983021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.983021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.983021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.983021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.983021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.983929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.983929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.983929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.983929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.984625] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.203195] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.203195] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.203195] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 already deleted. [ 1200.203195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.285673] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.286144] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.286393] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.287660] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.287660] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.287660] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.288128] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.288319] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.288574] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.288912] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.289139] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.289365] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.289575] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.290314] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.290314] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.290314] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.310197] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.310371] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.310538] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.310785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.311269] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-987a7fdb-89b7-43f2-8e09-54f0d96abafc taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.311522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.312195] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.312737] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.312990] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987a7fdb-89b7-43f2-8e09-54f0d96abafc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.490338] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f0e8ca4-9613-4991-a992-cf2ef6089b55: rpc.has_security_group_logging(os_id): False [ 1200.511301] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.512500] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.512500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.512869] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.512967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.513043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.513260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.513363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.513629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.513800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.513870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.514072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.514154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.514331] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be updated. [ 1200.576878] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.577056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.577126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.577365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.577526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.606907] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: IN_PROGRESS for 2s [ 1200.816614] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.816850] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.817008] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.817276] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.817430] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.817593] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 987a7fdb-89b7-43f2-8e09-54f0d96abafc not found, creating... [ 1200.817885] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.818070] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.818181] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.818445] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.818608] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.818902] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.819312] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.819472] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.819727] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.819878] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.820063] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc is going to be created. [ 1200.853825] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.854348] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.854348] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.854614] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.854844] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.855105] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.838316] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.838316] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.838316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.838316] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.847932] env[70032]: INFO networking_nsxv3.common.synchronization [req-d6b09ddb-0f56-4309-818a-28e59e57c1e3 req-3c6f2b36-8af7-4175-803b-f01c50629aa1 service nova] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1201.847932] env[70032]: INFO networking_nsxv3.common.synchronization [req-d6b09ddb-0f56-4309-818a-28e59e57c1e3 req-3c6f2b36-8af7-4175-803b-f01c50629aa1 service nova] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1201.847932] env[70032]: INFO networking_nsxv3.common.synchronization [req-d6b09ddb-0f56-4309-818a-28e59e57c1e3 req-3c6f2b36-8af7-4175-803b-f01c50629aa1 service nova] Enqueued Resource ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc with Priority: HIGHEST for action port [ 1201.847932] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1201.847932] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1201.847932] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc with Priority: HIGHEST for action port [ 1201.847932] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.847932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.848778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.849235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.849421] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.850823] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.851168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.851357] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.851886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.852336] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.854230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.854230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.854230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.854230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.854230] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.855045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-987a7fdb-89b7-43f2-8e09-54f0d96abafc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.855302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.855450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.855675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.855955] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987a7fdb-89b7-43f2-8e09-54f0d96abafc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.341763] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.351444] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.351590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.355251] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.358469] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 987a7fdb-89b7-43f2-8e09-54f0d96abafc with status ACTIVE [ 1202.358663] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.358828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.358861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.359066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.359178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.359328] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.359432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.359496] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.359653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.359730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.360024] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.360024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.360182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.360239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.360325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.360417] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc is going to be updated. [ 1202.379230] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.379459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.379459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.379626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.379753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.379903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.622635] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 1202.623040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.843582] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d6919e6-e32b-4e99-b10c-70b263dc0104: rpc.has_security_group_logging(os_id): False [ 1202.857368] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.860091] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.860243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.860316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.860531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.862060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.862060] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.862060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.862060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.862060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.862060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.862060] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1202.928385] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.928551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.928597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.928829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.929026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.942157] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1203.363945] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.364082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.364157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.364610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.364709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.364812] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be created. [ 1203.404825] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.405048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.405048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.405269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.405413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.415314] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: UNINITIALIZED for 2s [ 1206.221878] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.221878] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.221878] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.221878] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.221878] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.221878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.221878] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.226982] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.226982] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.226982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.226982] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.433567] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30009369-6f19-4944-a9ac-97ee4f709ca2: rpc.has_security_group_logging(os_id): False [ 1206.451781] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.451939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.452018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.452235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.452324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.452514] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.452611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.452675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.452835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.452913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.453131] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.453228] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.453306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.453457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.453533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.453718] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.453812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.453867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.454169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.454287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.454402] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be created. [ 1206.471955] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.472164] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.472306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.472639] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.472860] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.473042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.473195] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.473432] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.473595] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.473833] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.473966] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.474471] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.474553] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.474732] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.474879] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.475092] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.492537] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.492901] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1206.493401] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.493401] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-519" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.493660] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-3ffbca23-4842-4289-b341-c21a5f92364b taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.493867] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.494070] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.494379] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.494563] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ffbca23-4842-4289-b341-c21a5f92364b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.512219] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.512463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.512463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.512618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.512922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.524897] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1206.848318] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.848467] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1206.996578] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.996903] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.997153] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.997559] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.997771] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.998145] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.998294] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.998416] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.998647] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.998799] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.999136] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.999304] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.999423] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.999654] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.999813] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.000085] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 3ffbca23-4842-4289-b341-c21a5f92364b is going to be updated. [ 1207.024062] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.024062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.024062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.024062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.024062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.024062] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.805345] env[70032]: INFO networking_nsxv3.common.synchronization [req-6cb733f0-1374-45ff-9f05-f62116f6f35c req-4711b791-0a39-49f1-8658-811a9492d37b service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1207.805614] env[70032]: INFO networking_nsxv3.common.synchronization [req-6cb733f0-1374-45ff-9f05-f62116f6f35c req-4711b791-0a39-49f1-8658-811a9492d37b service nova] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1207.805614] env[70032]: INFO networking_nsxv3.common.synchronization [req-6cb733f0-1374-45ff-9f05-f62116f6f35c req-4711b791-0a39-49f1-8658-811a9492d37b service nova] Enqueued Resource ID: 3ffbca23-4842-4289-b341-c21a5f92364b with Priority: HIGHEST for action port [ 1207.805850] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_rules [ 1207.805979] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1207.806088] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffbca23-4842-4289-b341-c21a5f92364b with Priority: HIGHEST for action port [ 1207.806668] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.806797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.806869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.807443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.807539] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.809106] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.809251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.809322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.809503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.809656] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.809817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.809817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.809956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.810104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.810719] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.812971] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ffbca23-4842-4289-b341-c21a5f92364b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.812971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.812971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.812971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.812971] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ffbca23-4842-4289-b341-c21a5f92364b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.310065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.310065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.314070] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.315249] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ffbca23-4842-4289-b341-c21a5f92364b with status ACTIVE [ 1208.315477] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.316360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.316360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.316360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.316360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.316360] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.316577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.316608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.316821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.316936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.317275] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.317398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.317466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.317656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.317770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.317906] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ffbca23-4842-4289-b341-c21a5f92364b is going to be updated. [ 1208.339187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.339335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.339417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.339602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.339774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.339889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ffbca23-4842-4289-b341-c21a5f92364b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.539993] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1208.540266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.820210] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.322473] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.324921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.324921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.324921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.324921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.324921] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1209.350025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.350025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.350025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.350025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.350025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.359618] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1211.371299] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1211.371688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.371688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.371948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.372234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.372368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.372465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.372693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.372827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.372983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.373151] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.876065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.876238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.876313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.876533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.876704] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.876804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.876869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.877030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.877147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.877243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.877492] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.877625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.877721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.877926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.878102] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.878212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.878277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.878451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.878538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.878626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.878737] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.380889] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d880077d-b1e8-47fa-bc09-7da9308456b0: rpc.has_security_group_logging(os_id): False [ 1212.398118] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.398303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.398403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.398576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.398659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.398851] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.398945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.399011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.399243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.399365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.399800] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.399909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.399946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.400136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.400214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.400392] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.400502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.400558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.400679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.400756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.400843] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1212.461049] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.461306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.461443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.461804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.462102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.476365] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1212.806573] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1212.806723] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1214.492921] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1214.493306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.337968] env[70032]: INFO networking_nsxv3.common.synchronization [req-35ad71a0-0a67-497b-998c-c819491685c5 req-cca15cc9-8983-4389-946e-389a0bb7f65e tempest-ServerDiskConfigTestJSON-1630858858 tempest-ServerDiskConfigTestJSON-1630858858-project-member] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1215.338525] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGHEST for action security_group_members [ 1215.338900] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.339093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.339138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.339334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.339489] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.339590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.339645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.339801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.339913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.340011] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.846731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.847194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.847194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.847302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.847302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.847492] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.847588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.847672] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.847794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.847869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.847970] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be updated. [ 1215.881272] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.881504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.881504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.881670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.881809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.895494] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: IN_PROGRESS for 2s [ 1216.044180] env[70032]: INFO networking_nsxv3.common.synchronization [req-4fe2640f-1c03-415a-9591-37efb73c7891 req-269f7037-8eae-43e9-bcbb-2276b490e90c tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.044180] env[70032]: INFO networking_nsxv3.common.synchronization [req-4fe2640f-1c03-415a-9591-37efb73c7891 req-269f7037-8eae-43e9-bcbb-2276b490e90c tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.044180] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.044383] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.044775] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.044775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.044775] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.045200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.045428] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.045590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.045693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.045902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.046045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.046184] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.047119] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.047315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.047315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.048652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.048652] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.048652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.048652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.048652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.048652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.048652] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.095399] env[70032]: INFO networking_nsxv3.common.synchronization [req-4fe2640f-1c03-415a-9591-37efb73c7891 req-269f7037-8eae-43e9-bcbb-2276b490e90c tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1216.095578] env[70032]: INFO networking_nsxv3.common.synchronization [req-4fe2640f-1c03-415a-9591-37efb73c7891 req-269f7037-8eae-43e9-bcbb-2276b490e90c tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.095724] env[70032]: INFO networking_nsxv3.common.synchronization [req-4fe2640f-1c03-415a-9591-37efb73c7891 req-269f7037-8eae-43e9-bcbb-2276b490e90c tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_rules [ 1216.095857] env[70032]: INFO networking_nsxv3.common.synchronization [req-4fe2640f-1c03-415a-9591-37efb73c7891 req-269f7037-8eae-43e9-bcbb-2276b490e90c tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.095993] env[70032]: INFO networking_nsxv3.common.synchronization [req-4fe2640f-1c03-415a-9591-37efb73c7891 req-269f7037-8eae-43e9-bcbb-2276b490e90c tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc with Priority: HIGHEST for action port [ 1216.096742] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1216.096883] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_rules [ 1216.096984] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc with Priority: HIGHEST for action port [ 1216.097340] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.097340] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.098031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.098138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.098211] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.098415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.098492] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.099314] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.099513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.099513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.099695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.099769] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.100490] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-987a7fdb-89b7-43f2-8e09-54f0d96abafc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.100598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.100648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.100800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.100874] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987a7fdb-89b7-43f2-8e09-54f0d96abafc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.101576] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.101655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.101840] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.101919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.476885] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.476885] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_members [ 1216.476885] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.477169] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.477304] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_members [ 1216.477402] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.477682] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.477786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.478028] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f7eded-33f5-4584-a001-a880d502f14f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.478089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.478165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.478385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.478532] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.478622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.478700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.478831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.479125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.479125] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.479828] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.479922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.519019] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1216.519019] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.519019] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_rules [ 1216.519019] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_members [ 1216.519019] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_rules [ 1216.519019] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.519019] env[70032]: INFO networking_nsxv3.common.synchronization [req-c89c87fa-6248-435e-b90f-80663c636a13 req-737e3d35-4597-4d97-bd7a-96a28c4a9fcb tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc with Priority: HIGHEST for action port [ 1216.519536] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1216.519687] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_rules [ 1216.519806] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1216.519949] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc with Priority: HIGHEST for action port [ 1216.520043] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_rules [ 1216.520167] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1216.520310] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_members [ 1216.520629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.520754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.521078] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57f7eded-33f5-4584-a001-a880d502f14f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.521212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.521342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.521624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.521752] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.523472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.523472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.523472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-987a7fdb-89b7-43f2-8e09-54f0d96abafc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.523706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.523706] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.523847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.524044] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.524166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.524360] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f7eded-33f5-4584-a001-a880d502f14f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.524526] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.551183] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.551293] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.603373] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.603634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.604857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.605073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.605148] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 987a7fdb-89b7-43f2-8e09-54f0d96abafc with status ACTIVE [ 1216.605257] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.605378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.605444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.605658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.605746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.605914] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.606026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.606083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.606259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.606336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.606512] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.606603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.606663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.606798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.606871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.606953] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc is going to be updated. [ 1216.628278] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.628278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.628278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.628278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.628278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.628278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.628278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.628278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.628278] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987a7fdb-89b7-43f2-8e09-54f0d96abafc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.981239] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.025538] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f7eded-33f5-4584-a001-a880d502f14f taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.025805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.052705] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.053692] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.130373] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 987a7fdb-89b7-43f2-8e09-54f0d96abafc with status ACTIVE [ 1217.130648] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.130785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.130852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.131109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.131218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.131394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.131608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.131608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.131788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.131870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.132080] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.132180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.132242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.132399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.132479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.132564] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 987a7fdb-89b7-43f2-8e09-54f0d96abafc is going to be updated. [ 1217.154762] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.154976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.154976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.155330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.155386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.155560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-987a7fdb-89b7-43f2-8e09-54f0d96abafc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.485695] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.556418] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.556697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.556908] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.557296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.557481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.557670] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be created. [ 1217.559403] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.559628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.559792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.560116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.560300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.560483] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1217.585825] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.585825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.585825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.586064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.586257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.589031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.589031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.589031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.589308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.589308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.598575] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1217.599455] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: UNINITIALIZED for 2s [ 1217.905334] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 in Status: SUCCESS [ 1217.905589] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 deletion is rescheduled due to dependency. [ 1217.905698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.988516] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.988819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.988868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.989182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.989311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.989444] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f7eded-33f5-4584-a001-a880d502f14f is going to be created. [ 1218.011892] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.012068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.012114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.012326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.012489] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.021509] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: UNINITIALIZED for 2s [ 1219.608326] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: SUCCESS [ 1219.608587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.608726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.608909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.609103] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.609244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.609369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.609457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.609540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.609649] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.611026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1219.611199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.611343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.611536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.611670] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.611772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.611836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.611978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.612068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.612153] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.021118] env[70032]: INFO networking_nsxv3.common.synchronization [req-6ec5dbbd-10a3-4e64-b730-467e66e381cb req-92017d75-edda-4756-8bd7-f53f237ef616 tempest-ServersTestBootFromVolume-1935082994 tempest-ServersTestBootFromVolume-1935082994-project-member] Enqueued Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_members [ 1220.021709] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGHEST for action security_group_members [ 1220.022857] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.022994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.023070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.023256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.023410] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.023510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.023569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.023712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.023796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.023887] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.033289] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: SUCCESS [ 1220.033555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.033962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.034173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.034346] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.034456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.034519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.034662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.034742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.034831] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.114062] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.116580] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.527887] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.529043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.529043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.529043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.529043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.529269] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.529269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.529269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.529425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.529502] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.529627] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 is going to be updated. [ 1220.536445] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.555376] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.556043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.556043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.556043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.556225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.563775] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 in Status: IN_PROGRESS for 2s [ 1220.615596] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.621297] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.040373] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.118032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.118032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.118032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.118224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.118831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.119050] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be updated. [ 1221.122907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.123088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.123199] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.123446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.123564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.123689] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1221.152552] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.152705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.152756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.152960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.153178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.154842] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.154959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.155071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.155200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.155330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.165217] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1221.165849] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: IN_PROGRESS for 2s [ 1221.542564] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.542748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.542931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.543060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.543153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.543256] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f7eded-33f5-4584-a001-a880d502f14f is going to be updated. [ 1221.572629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.572790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.572831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.573109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.573247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.581962] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: IN_PROGRESS for 2s [ 1222.573112] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 in Status: SUCCESS [ 1222.573458] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 deletion is rescheduled due to dependency. [ 1222.573458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.178634] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: SUCCESS [ 1223.178847] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.179581] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1223.179718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.179861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.180083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.180256] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.180716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.180716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.180716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.180716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.180716] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.182080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.182203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.182364] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.182461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.182521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.182828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.182828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.182828] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.464928] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b8c79216-fc23-4c17-9344-0ec9df71114b None None] Enqueued Resource ID: 3f6ba251-190d-4d73-96a1-e3be3e6ce9dc with Priority: HIGHEST for action port [ 1223.465419] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6ba251-190d-4d73-96a1-e3be3e6ce9dc with Priority: HIGHEST for action port [ 1223.465688] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f6ba251-190d-4d73-96a1-e3be3e6ce9dc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.465810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f6ba251-190d-4d73-96a1-e3be3e6ce9dc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.465875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f6ba251-190d-4d73-96a1-e3be3e6ce9dc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.466237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f6ba251-190d-4d73-96a1-e3be3e6ce9dc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.466321] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f6ba251-190d-4d73-96a1-e3be3e6ce9dc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.481349] env[70032]: INFO networking_nsxv3.common.synchronization [req-229bf4b7-aac7-4c18-985d-e614a7c11c24 req-beafdddf-e104-45ba-b38b-a45720020524 tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1223.481988] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1223.482292] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.482411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.593225] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: SUCCESS [ 1223.593518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.594310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.594310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.594310] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.594310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.594310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.594602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.594602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.594602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.594602] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.687516] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.689119] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.733246] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c5402ded-d95f-4451-8cdf-0d2e60e81f3c tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1223.733653] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1223.733971] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.734104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.734171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.734415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.734499] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.827712] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d95d8722-d269-4d72-9a50-f31f692aa468 tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1223.828218] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1223.828531] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.828696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.968426] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f6ba251-190d-4d73-96a1-e3be3e6ce9dc [ 1223.968426] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.968746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.968746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.968864] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.968919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.969047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f6ba251-190d-4d73-96a1-e3be3e6ce9dc already deleted. [ 1223.969132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f6ba251-190d-4d73-96a1-e3be3e6ce9dc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.101644] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.190194] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.194221] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.209953] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.210179] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.210332] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.210620] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.210887] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.211066] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.211191] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.211415] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.212042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.212270] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.212393] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.212508] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.212623] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.212737] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.212852] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.212990] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.232155] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.232346] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.232495] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.232672] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-899" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.232986] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-d3732dad-6b7f-4f49-839b-bde0f646fe85 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.233407] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.233407] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.233619] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.233764] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3732dad-6b7f-4f49-839b-bde0f646fe85',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.350937] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.351161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.351161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.351384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.351454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.351547] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 already deleted. [ 1224.351701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.351921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.352137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.352255] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.605743] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57f7eded-33f5-4584-a001-a880d502f14f: rpc.has_security_group_logging(os_id): False [ 1224.622661] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.622826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.622886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.623105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.623202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.623433] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.623535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.623600] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.623755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.623832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.623916] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57f7eded-33f5-4584-a001-a880d502f14f is going to be created. [ 1224.674065] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.674266] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.674322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.674498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.674667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.684639] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: IN_PROGRESS for 2s [ 1224.693221] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.693347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.693419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.693617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.693711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.693805] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1224.698462] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.698462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.698462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.698462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.698462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.698462] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be updated. [ 1224.722922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.723096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.723168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.723360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.723504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.725369] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.725527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.725527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.725702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.725823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.734926] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: IN_PROGRESS for 2s [ 1224.735872] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.736124] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.736257] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.736506] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.736657] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.736818] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port d3732dad-6b7f-4f49-839b-bde0f646fe85 not found, creating... [ 1224.737088] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.737305] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.737444] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.737657] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.737869] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.738673] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.739051] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.739241] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.739751] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.739927] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.740119] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 is going to be created. [ 1224.742357] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1224.779615] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.780863] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.781182] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.781929] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.782376] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.782625] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.878935] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.879108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.879180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.879718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.879841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.879946] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 already deleted. [ 1224.880050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.446377] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f1812f6a-7f1a-4cd6-bb53-ed3bb290f1b5 None None] Enqueued Resource ID: 6bb30291-7d42-45ee-8651-d56dbb56913c with Priority: HIGHEST for action port [ 1225.446628] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb30291-7d42-45ee-8651-d56dbb56913c with Priority: HIGHEST for action port [ 1225.447234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb30291-7d42-45ee-8651-d56dbb56913c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.447350] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb30291-7d42-45ee-8651-d56dbb56913c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.447450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb30291-7d42-45ee-8651-d56dbb56913c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.447680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb30291-7d42-45ee-8651-d56dbb56913c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.447776] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb30291-7d42-45ee-8651-d56dbb56913c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.691162] env[70032]: INFO networking_nsxv3.common.synchronization [req-229bf4b7-aac7-4c18-985d-e614a7c11c24 req-7aa67c8e-d77d-4ed7-9329-13cc00959e79 service nova] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1225.691162] env[70032]: INFO networking_nsxv3.common.synchronization [req-229bf4b7-aac7-4c18-985d-e614a7c11c24 req-7aa67c8e-d77d-4ed7-9329-13cc00959e79 service nova] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1225.691859] env[70032]: INFO networking_nsxv3.common.synchronization [req-229bf4b7-aac7-4c18-985d-e614a7c11c24 req-7aa67c8e-d77d-4ed7-9329-13cc00959e79 service nova] Enqueued Resource ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 with Priority: HIGHEST for action port [ 1225.692583] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1225.692870] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1225.693105] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 with Priority: HIGHEST for action port [ 1225.693497] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.693748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.694170] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.695821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.695821] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3732dad-6b7f-4f49-839b-bde0f646fe85 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.695821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.695821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.695821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.695821] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3732dad-6b7f-4f49-839b-bde0f646fe85',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.953734] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bb30291-7d42-45ee-8651-d56dbb56913c [ 1225.954234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.954547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.955407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.955407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.955407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.955407] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bb30291-7d42-45ee-8651-d56dbb56913c already deleted. [ 1225.955407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb30291-7d42-45ee-8651-d56dbb56913c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.084188] env[70032]: INFO networking_nsxv3.common.synchronization [req-73080a54-759c-4bc2-9e0e-15b7b116ba0b req-04c093c7-28e4-4182-ba9b-35ef77bc5039 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1226.084188] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1226.084188] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.084188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.084188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.084750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.085082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.085344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.085517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.085789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.085966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.086171] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.201030] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3732dad-6b7f-4f49-839b-bde0f646fe85 with status ACTIVE [ 1226.201030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.201030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.201030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.201030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.201030] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 is going to be updated. [ 1226.223043] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.224653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.224653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.224791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.224935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.225116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.588253] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.696444] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: SUCCESS [ 1226.696901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.744480] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: SUCCESS [ 1226.744773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.745047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.745047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.745227] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.745343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.745409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.745562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.745716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.745771] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.748168] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1226.748693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.748693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.748693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.749083] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.749083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.749166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.749450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.749450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.749638] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.091743] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.249489] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.250947] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.594345] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.594517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.594662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.594793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.594882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.595097] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 is going to be updated. [ 1227.624117] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.624117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.624117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.624117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.624117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.630784] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: IN_PROGRESS for 2s [ 1227.751688] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.756288] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.254072] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.254244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.255612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.255612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.255612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.255612] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be updated. [ 1228.258533] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.258666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.258740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.258914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.258996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.259104] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1228.290815] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.290922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.290997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.291231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.291372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.293409] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.293627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.293748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.293968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.294172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.304229] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1228.305256] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: IN_PROGRESS for 2s [ 1229.641155] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: SUCCESS [ 1229.641155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.719028] env[70032]: INFO networking_nsxv3.common.synchronization [None req-8d67e9be-b966-43ee-b541-eb5b57a68ab2 None None] Enqueued Resource ID: 3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8 with Priority: HIGHEST for action port [ 1229.719028] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8 with Priority: HIGHEST for action port [ 1229.719794] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.720135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.721891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.721891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.721891] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.175231] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf780d24-af26-4adf-aff3-124c37fcf8d8 req-cc8c5f96-e22e-4c24-b8e9-a4c004ca4f0d tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1230.175987] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1230.175987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.175987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.176188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.176378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.176553] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.176657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.176719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.176870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.176972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.177690] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.225792] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8 [ 1230.226049] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.226187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.226253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.226457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.226541] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.226628] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8 already deleted. [ 1230.226701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd2f5a5-a9d0-477d-87ba-fbc2803bb3a8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.315786] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: SUCCESS [ 1230.315786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.316206] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1230.316321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.316471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.316677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.316856] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.316970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.317043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.317212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.317293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.317378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.317469] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.318292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.318463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.318619] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.318723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.318784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.318975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.319177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.319177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.319299] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.320145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.320295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.320520] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.320586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.320665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.320891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.320978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.321078] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.541719] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.541953] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.542123] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.542447] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.542742] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.542904] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.543039] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.543273] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.543921] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.543921] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.543921] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.543921] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.546126] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.546126] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.546126] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.546126] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.564208] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.564399] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1230.564548] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.564728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.565071] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-28668808-b14f-4f01-af34-5549e32d71fd taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.565253] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.565380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.565760] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.565912] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28668808-b14f-4f01-af34-5549e32d71fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.680145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.683165] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.683165] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 already deleted. [ 1230.683165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.821130] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.823344] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.823457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.826358] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.850745] env[70032]: INFO networking_nsxv3.common.synchronization [req-80a23dfc-566f-4501-8f33-9ec0444e5252 req-75c22d91-5ec6-419b-af29-cd129d24ce6b tempest-DeleteServersTestJSON-1735915104 tempest-DeleteServersTestJSON-1735915104-project-member] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1230.850846] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGHEST for action security_group_members [ 1230.851106] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.851227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.851346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.851969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.851969] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.851969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.851969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.851969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.851969] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.852291] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.069077] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.069372] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.069527] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.069822] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.069982] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.070156] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 28668808-b14f-4f01-af34-5549e32d71fd not found, creating... [ 1231.070425] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.070591] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.070713] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.070952] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.071108] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.071684] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.072033] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.072260] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.072568] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.072775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.072960] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 28668808-b14f-4f01-af34-5549e32d71fd is going to be created. [ 1231.093774] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.093774] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.093774] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.094053] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.094298] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.094545] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.324907] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2e38683-4e39-4757-9135-1e4fb3be9d1c: rpc.has_security_group_logging(os_id): False [ 1231.326842] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.354499] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.354659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.354659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.354952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.354952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.355262] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.355262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.355901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.355901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.355901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.355901] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be updated. [ 1231.369729] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.369867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.370026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.370225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.370435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.370685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.370801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.370892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.371087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.371175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.371273] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be created. [ 1231.385866] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.386029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.386111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.386317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.386495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.397329] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: IN_PROGRESS for 2s [ 1231.442037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.442287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.442394] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.442631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.442804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.462775] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: IN_PROGRESS for 2s [ 1231.775330] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf780d24-af26-4adf-aff3-124c37fcf8d8 req-9cc8f7d0-68f6-4ada-ab2e-fba3c7956a29 service nova] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1231.775571] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf780d24-af26-4adf-aff3-124c37fcf8d8 req-9cc8f7d0-68f6-4ada-ab2e-fba3c7956a29 service nova] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1231.775715] env[70032]: INFO networking_nsxv3.common.synchronization [req-cf780d24-af26-4adf-aff3-124c37fcf8d8 req-9cc8f7d0-68f6-4ada-ab2e-fba3c7956a29 service nova] Enqueued Resource ID: 28668808-b14f-4f01-af34-5549e32d71fd with Priority: HIGHEST for action port [ 1231.775953] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1231.776099] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1231.776193] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28668808-b14f-4f01-af34-5549e32d71fd with Priority: HIGHEST for action port [ 1231.777150] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.777150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.777150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.777358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.777358] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.780616] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.780616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.780616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.780616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.780616] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.780616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.780616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.780616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.780616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.780616] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.781089] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-28668808-b14f-4f01-af34-5549e32d71fd taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.781089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.781089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.781264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.781424] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28668808-b14f-4f01-af34-5549e32d71fd',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.829662] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.829841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.829954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.830195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.830295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.830418] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1231.858643] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.858805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.858891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.859114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.859255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.867319] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1232.157219] env[70032]: INFO networking_nsxv3.common.synchronization [None req-771cb326-adb8-41d4-b5a0-aea965047b16 None None] Enqueued Resource ID: e58dd4be-8323-4882-b5f2-23bd4a682c8a with Priority: HIGHEST for action port [ 1232.157219] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58dd4be-8323-4882-b5f2-23bd4a682c8a with Priority: HIGHEST for action port [ 1232.157219] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e58dd4be-8323-4882-b5f2-23bd4a682c8a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.157219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e58dd4be-8323-4882-b5f2-23bd4a682c8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.157219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e58dd4be-8323-4882-b5f2-23bd4a682c8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.157219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e58dd4be-8323-4882-b5f2-23bd4a682c8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.157219] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58dd4be-8323-4882-b5f2-23bd4a682c8a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.284146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.284146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.284146] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.285236] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28668808-b14f-4f01-af34-5549e32d71fd with status ACTIVE [ 1232.285236] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.285236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.285236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.285580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.285660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.285849] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.285997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.286115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.286323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.286448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.286707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.286866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.286989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.287195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.287714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.287714] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28668808-b14f-4f01-af34-5549e32d71fd is going to be updated. [ 1232.307984] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.308231] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.308336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.308597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.308796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.309052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28668808-b14f-4f01-af34-5549e32d71fd" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.659105] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e58dd4be-8323-4882-b5f2-23bd4a682c8a [ 1232.659444] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.659591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.659660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.659875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.659965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.660071] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e58dd4be-8323-4882-b5f2-23bd4a682c8a already deleted. [ 1232.660165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e58dd4be-8323-4882-b5f2-23bd4a682c8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.789424] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.292739] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.292869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.292911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.293419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.293419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.293419] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be created. [ 1233.316465] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.316595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.316682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.316950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.317348] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.326677] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: UNINITIALIZED for 2s [ 1233.410510] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac44685-7555-444d-b1ce-19ece671a825 in Status: SUCCESS [ 1233.410814] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 deletion is rescheduled due to dependency. [ 1233.410985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.476033] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: SUCCESS [ 1233.476153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.476361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.476582] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.476675] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.653426] env[70032]: INFO networking_nsxv3.common.synchronization [req-4bb08246-f61a-42d0-a05b-3c9d55a38fc1 req-3e870ca0-3879-4b40-8c81-975a69e3ce9a tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1233.653426] env[70032]: INFO networking_nsxv3.common.synchronization [req-4bb08246-f61a-42d0-a05b-3c9d55a38fc1 req-3e870ca0-3879-4b40-8c81-975a69e3ce9a tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1233.654257] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1233.654328] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1233.654629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.654735] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.654991] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.655117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.655182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.655450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.655600] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.655699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.655764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.655929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.656054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.656130] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.705779] env[70032]: INFO networking_nsxv3.common.synchronization [req-4bb08246-f61a-42d0-a05b-3c9d55a38fc1 req-3e870ca0-3879-4b40-8c81-975a69e3ce9a tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_rules [ 1233.705779] env[70032]: INFO networking_nsxv3.common.synchronization [req-4bb08246-f61a-42d0-a05b-3c9d55a38fc1 req-3e870ca0-3879-4b40-8c81-975a69e3ce9a tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1233.705779] env[70032]: INFO networking_nsxv3.common.synchronization [req-4bb08246-f61a-42d0-a05b-3c9d55a38fc1 req-3e870ca0-3879-4b40-8c81-975a69e3ce9a tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1233.705779] env[70032]: INFO networking_nsxv3.common.synchronization [req-4bb08246-f61a-42d0-a05b-3c9d55a38fc1 req-3e870ca0-3879-4b40-8c81-975a69e3ce9a tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1233.705957] env[70032]: INFO networking_nsxv3.common.synchronization [req-4bb08246-f61a-42d0-a05b-3c9d55a38fc1 req-3e870ca0-3879-4b40-8c81-975a69e3ce9a tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 with Priority: HIGHEST for action port [ 1233.706399] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_rules [ 1233.706546] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1233.706623] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 with Priority: HIGHEST for action port [ 1233.706715] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1233.707769] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1233.707769] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.707769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.707769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.707769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.707769] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.708432] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.708546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.708752] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3732dad-6b7f-4f49-839b-bde0f646fe85 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.708875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.709028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.709140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.709251] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3732dad-6b7f-4f49-839b-bde0f646fe85',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.709922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.709998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.710234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.710284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.876667] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1233.876996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.877065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.877288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.877473] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.877592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.877655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.877802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.877884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.877977] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.978961] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.979142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.979142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.979373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.979588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.979701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.979759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.979926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.980023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.980115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.980204] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.158448] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.211112] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3732dad-6b7f-4f49-839b-bde0f646fe85 with status ACTIVE [ 1234.211428] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.211576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.211655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.211950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.212077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.212277] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.212409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.212491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.212643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.213372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.213372] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.213372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.213372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.213372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.213372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.213600] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 is going to be updated. [ 1234.214795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.214897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.241894] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.241973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.242065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.242365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.242444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.242539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.380423] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.482951] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.661537] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.883894] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.985329] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2e38683-4e39-4757-9135-1e4fb3be9d1c: rpc.has_security_group_logging(os_id): False [ 1235.001893] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.002136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.002222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.002444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.002536] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.002831] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.002911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.002946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.003089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.003161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.003249] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be updated. [ 1235.065694] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.065848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.065921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.066150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.066299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.078759] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: IN_PROGRESS for 2s [ 1235.163907] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.164070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.164136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.164347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.164436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.164536] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 is going to be created. [ 1235.193303] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.193460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.193513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.193689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.194079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.203200] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: UNINITIALIZED for 2s [ 1235.335477] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1235.335753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.335944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.336212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.336429] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.336557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.336624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.336781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.336863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.336950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.337054] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.385718] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.385862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.385929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.386168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.386263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.386362] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1235.416336] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.416505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.416505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.416709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.416842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.424368] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1235.839789] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.122018] env[70032]: INFO networking_nsxv3.common.synchronization [req-752fd601-a743-4d6e-a9bf-fc85768a863e req-495cec07-4059-4837-8286-1a6b5dec62b1 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1236.122018] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 with Priority: HIGHEST for action security_group_members [ 1236.122018] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec6619bd-9b1f-429e-957b-14f3db7e57f0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.122018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.122018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.122018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.122704] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.122976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.123182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.123453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.123645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.123831] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec6619bd-9b1f-429e-957b-14f3db7e57f0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.290565] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e2f027-9e51-44a5-8d4c-09521e145037 req-ebd018a1-5760-4577-9cf1-f81ef79283bf tempest-ServerMetadataNegativeTestJSON-2114290645 tempest-ServerMetadataNegativeTestJSON-2114290645-project-member] Enqueued Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_members [ 1236.291298] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_members [ 1236.291298] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.291416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.291416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.292020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.292020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.292020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.292020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.292243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.292243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.292431] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.342333] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1110e864-8fe2-4147-ac63-04a6f0d7e278: rpc.has_security_group_logging(os_id): False [ 1236.363605] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.363762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.363859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.364036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.364134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.364378] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.364480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.364544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.364702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.364797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.364862] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be created. [ 1236.424137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.424354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.424503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.424732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.424929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.438595] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: IN_PROGRESS for 2s [ 1236.566123] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.566337] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-94" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.566467] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-94" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.566794] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-94" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.567069] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.567260] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.567492] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.567720] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.567870] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.568094] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.568213] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.568325] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.568435] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.568548] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.568657] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.568792] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.586072] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.586200] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.586343] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.586507] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-94" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.586780] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-6693f8f1-2edc-4eb5-9ad0-020e10c96457 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.586941] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.587079] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.587349] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.587488] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6693f8f1-2edc-4eb5-9ad0-020e10c96457',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.627953] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.627953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.627953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.627953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.627953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.627953] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.627953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.628319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.628319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.628319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.628319] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 is going to be updated. [ 1236.654010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.654232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.654344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.654639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.654868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.663289] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: IN_PROGRESS for 2s [ 1236.794427] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.794629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.794629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.794822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.794918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.795129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.795234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.795305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.795458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.795543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.795627] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531ad586-f734-4279-9db3-fc308558885e already deleted. [ 1236.795700] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.090083] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.090083] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.090083] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.090083] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.090552] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.090552] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 6693f8f1-2edc-4eb5-9ad0-020e10c96457 not found, creating... [ 1237.090631] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.090768] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.090910] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.091153] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.091301] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.091586] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.091748] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.091866] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.092096] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.092238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.092396] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 6693f8f1-2edc-4eb5-9ad0-020e10c96457 is going to be created. [ 1237.093886] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: SUCCESS [ 1237.094096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.110563] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.110906] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.111022] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.111244] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.111476] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.111710] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.216593] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: SUCCESS [ 1237.216846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.217086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.217331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.217566] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.217722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.217802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.217995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.218103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.218197] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.445180] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1237.445411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.445579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.445790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.445979] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.446113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.446179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.446333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.446416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.446503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.446664] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.446744] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.446804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.446974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.447154] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.447251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.447314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.447472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.447543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.447625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.447718] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.448532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.448720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.448848] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.448944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.449015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.449156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.449233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.449318] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.721025] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.951129] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30009369-6f19-4944-a9ac-97ee4f709ca2: rpc.has_security_group_logging(os_id): False [ 1237.953071] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.969194] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.969992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.970102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.970294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.970381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.970582] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.970726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.970781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.970889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.970955] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.971165] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.971253] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.971313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.971452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.971518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.971706] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.971808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.971869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.972018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.972349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.972467] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1238.029335] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.031484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.031588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.031798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.031950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.043178] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1238.088673] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e2f027-9e51-44a5-8d4c-09521e145037 req-3eb67d8e-b9d3-453a-869a-447cacdaac0b service nova] Enqueued Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_rules [ 1238.088862] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e2f027-9e51-44a5-8d4c-09521e145037 req-3eb67d8e-b9d3-453a-869a-447cacdaac0b service nova] Enqueued Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_members [ 1238.089015] env[70032]: INFO networking_nsxv3.common.synchronization [req-83e2f027-9e51-44a5-8d4c-09521e145037 req-3eb67d8e-b9d3-453a-869a-447cacdaac0b service nova] Enqueued Resource ID: 6693f8f1-2edc-4eb5-9ad0-020e10c96457 with Priority: HIGHEST for action port [ 1238.089249] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_rules [ 1238.089385] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_members [ 1238.089956] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6693f8f1-2edc-4eb5-9ad0-020e10c96457 with Priority: HIGHEST for action port [ 1238.090177] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.090303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.090370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.090656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.090743] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.091584] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.091697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.091766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.091935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.092433] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.092595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.092679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.092831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.092920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.093033] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.097021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-6693f8f1-2edc-4eb5-9ad0-020e10c96457 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.097021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.097021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.097021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.097021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6693f8f1-2edc-4eb5-9ad0-020e10c96457',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.222996] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.449029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1238.449326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.454712] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.595997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.596213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.596408] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.599273] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6693f8f1-2edc-4eb5-9ad0-020e10c96457 with status ACTIVE [ 1238.599273] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.599273] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.599273] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.599273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.599834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.599834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.599834] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6693f8f1-2edc-4eb5-9ad0-020e10c96457 is going to be updated. [ 1238.620036] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.620036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.620036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.620036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.620036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.620036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6693f8f1-2edc-4eb5-9ad0-020e10c96457" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.676089] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 in Status: SUCCESS [ 1238.676291] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec6619bd-9b1f-429e-957b-14f3db7e57f0 deletion is rescheduled due to dependency. [ 1238.676391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec6619bd-9b1f-429e-957b-14f3db7e57f0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.727245] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.727245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.727449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.728758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.728758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.728758] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 is going to be updated. [ 1238.785536] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.785833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.785833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.786127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.786209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.792281] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_members [ 1238.792453] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1238.792593] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1238.792819] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_members [ 1238.792944] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1238.793131] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1238.794577] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: IN_PROGRESS for 2s [ 1238.794577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.794983] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.795069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.795363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.798554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.798554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.798554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.798554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.798554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.798554] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.798554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.798554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.798554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.798554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.843384] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_rules [ 1238.843928] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1238.843928] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1238.843928] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1238.843928] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_rules [ 1238.844194] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_members [ 1238.844194] env[70032]: INFO networking_nsxv3.common.synchronization [req-42f30a67-d010-4b59-8c20-fd52b0497fcf req-1ecc9b60-b4f6-4b2f-9231-40e12ffd5bbd tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 with Priority: HIGHEST for action port [ 1238.845353] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_rules [ 1238.845517] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_rules [ 1238.845646] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_members [ 1238.845764] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 with Priority: HIGHEST for action port [ 1238.845893] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_rules [ 1238.846015] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1238.846136] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1238.846893] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.847050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.847588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.847588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.847588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.847740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.847930] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3732dad-6b7f-4f49-839b-bde0f646fe85 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.848071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.848162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.848386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.848505] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3732dad-6b7f-4f49-839b-bde0f646fe85',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.849558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.849693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.849779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.850024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.850132] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.850879] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.851079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.851375] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.851375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.959646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.959840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.959916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.960207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.960301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.960462] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1238.988244] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.988397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.988460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.988666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.988812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.996577] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1239.098605] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.298301] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.352720] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3732dad-6b7f-4f49-839b-bde0f646fe85 with status ACTIVE [ 1239.352949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.353120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.353182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.353455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.353455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.353598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.353679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.353740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.353890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.353963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.354153] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.354237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.354296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.354431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.354504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.354584] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3732dad-6b7f-4f49-839b-bde0f646fe85 is going to be updated. [ 1239.355704] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.355848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.374215] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.374368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.374407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.374623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.374796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.374906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3732dad-6b7f-4f49-839b-bde0f646fe85" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.600538] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.600713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.600785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.601012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.601121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.601217] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531ad586-f734-4279-9db3-fc308558885e is going to be created. [ 1239.625735] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.625920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.625986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.626247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.626431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.634726] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531ad586-f734-4279-9db3-fc308558885e in Status: UNINITIALIZED for 2s [ 1239.800338] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.056965] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1240.057216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.057466] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.057770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.057913] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.302965] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.303274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.305880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.305880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.305880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.305880] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a is going to be created. [ 1240.326582] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.326737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.326784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.326990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.327171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.336067] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a in Status: UNINITIALIZED for 2s [ 1240.568505] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.568639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.804480] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: SUCCESS [ 1240.804694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.804861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.805101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.805282] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.805395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.805464] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.805620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.805696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.805778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.805872] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.806733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.806902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.808796] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.808931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.808989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.809157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.809343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.809343] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.926635] env[70032]: INFO networking_nsxv3.common.synchronization [None req-12a5f49c-a662-4ff8-9a55-dfabee0b8025 tempest-AttachInterfacesTestJSON-642463133 tempest-AttachInterfacesTestJSON-642463133-project-member] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1240.929318] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGHEST for action security_group_members [ 1240.929476] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.929589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.929659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.929872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.930037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.930139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.930210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.930358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.930452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.930600] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.005516] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1241.005605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.005720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.005941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.006137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.006255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.006320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.006477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.006559] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.006654] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.311650] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.316934] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.432620] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.433293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.433408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.433674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.433821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.434486] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.434688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.434796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.434999] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.435191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.435191] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be updated. [ 1241.466925] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.467727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.467727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.471019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.471019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.474353] env[70032]: INFO networking_nsxv3.common.synchronization [req-bcb8d954-553d-4f6d-b12a-708b5121b08c req-6f498f94-beb3-4aa4-a10f-4c4640af820f tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_members [ 1241.474445] env[70032]: INFO networking_nsxv3.common.synchronization [req-bcb8d954-553d-4f6d-b12a-708b5121b08c req-6f498f94-beb3-4aa4-a10f-4c4640af820f tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1241.474595] env[70032]: INFO networking_nsxv3.common.synchronization [req-bcb8d954-553d-4f6d-b12a-708b5121b08c req-6f498f94-beb3-4aa4-a10f-4c4640af820f tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1241.474817] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a with Priority: HIGHEST for action security_group_members [ 1241.474940] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1241.475045] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 with Priority: HIGHEST for action security_group_members [ 1241.475585] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.475686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.476112] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.476112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.477719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-146e1b84-bae5-4992-b20b-a7c269ee2af9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.477719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.480395] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: IN_PROGRESS for 2s [ 1241.508485] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.644670] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531ad586-f734-4279-9db3-fc308558885e in Status: SUCCESS [ 1241.644946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.645251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.645470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.645699] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.645948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.646058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.646248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.646426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.646501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.646568] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.807097] env[70032]: INFO networking_nsxv3.common.synchronization [None req-a6d40c55-bca5-4aef-bfe1-37ddc14843b2 None None] Enqueued Resource ID: da3a55bd-7071-4172-832c-00ff5559d760 with Priority: HIGHEST for action port [ 1241.807338] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da3a55bd-7071-4172-832c-00ff5559d760 with Priority: HIGHEST for action port [ 1241.807960] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-da3a55bd-7071-4172-832c-00ff5559d760 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.808226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da3a55bd-7071-4172-832c-00ff5559d760" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.808226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da3a55bd-7071-4172-832c-00ff5559d760" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.809312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da3a55bd-7071-4172-832c-00ff5559d760" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.809312] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da3a55bd-7071-4172-832c-00ff5559d760',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.818283] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 146e1b84-bae5-4992-b20b-a7c269ee2af9: rpc.has_security_group_logging(os_id): False [ 1241.821090] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.836064] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.836064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.836064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.836378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.836378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.836605] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.836687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.836762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.837426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.837426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.837426] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 is going to be created. [ 1241.890507] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.891118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.891118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.891118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.891280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.900523] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: IN_PROGRESS for 2s [ 1242.013040] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.149414] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.149802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.149802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.150093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.150321] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.150491] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.150616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.150822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.150960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.151111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.151594] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.151594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.151594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.151594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.151854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.152022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.152122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.152275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.152362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.152431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.152521] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.312090] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da3a55bd-7071-4172-832c-00ff5559d760 [ 1242.312090] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.312090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.312090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.312090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.312090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.312090] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da3a55bd-7071-4172-832c-00ff5559d760 already deleted. [ 1242.312641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da3a55bd-7071-4172-832c-00ff5559d760" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.322903] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.323127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.323667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.323667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.323667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.323905] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 is going to be updated. [ 1242.503730] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.504095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.504095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.504258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.504329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.515780] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a in Status: SUCCESS [ 1242.516118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.516502] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.517937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.517937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.517937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.517937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.517937] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1242.518208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.518430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.518628] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.518749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.518817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.518970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.519087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.519194] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.520832] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: IN_PROGRESS for 2s [ 1242.545965] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.545965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.545965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.546314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.546314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.559391] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1242.656571] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531ad586-f734-4279-9db3-fc308558885e: rpc.has_security_group_logging(os_id): False [ 1242.673173] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.673360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.673420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.673601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.673685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.673912] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.674040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.674105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.674256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.674332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.674510] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.674605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.674654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.674793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.674972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.675071] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.675148] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.675194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.675323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.675393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.675477] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531ad586-f734-4279-9db3-fc308558885e is going to be created. [ 1242.733791] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.733791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.733791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.733791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.733791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.742281] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531ad586-f734-4279-9db3-fc308558885e in Status: IN_PROGRESS for 2s [ 1243.022965] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.023088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.023141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.026032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.026032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.026032] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.026032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.026032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.026032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.026032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.026032] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a is going to be deleted. [ 1243.051820] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.051982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.052104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.052275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.052369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.052465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.052977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.053159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.053325] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.053421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.053572] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.053634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.053687] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.053819] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.489770] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d880077d-b1e8-47fa-bc09-7da9308456b0 in Status: SUCCESS [ 1243.490046] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 deletion is rescheduled due to dependency. [ 1243.490084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.556248] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.556640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.556723] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.556946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.557073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.557296] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.557396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.557458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.557644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.557724] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.557808] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a already deleted. [ 1243.557885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.557987] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.558855] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.559331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.559537] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.559675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.560427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.560655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.560778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.560898] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.608968] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.609211] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.609342] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.609642] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.609920] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.610091] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.610212] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.610428] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.610587] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.610856] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.610999] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1243.611155] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1243.611278] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1243.611400] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.611517] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1243.611683] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1243.630486] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1243.630739] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1243.631085] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1243.631357] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.631813] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-2e269fb7-5662-434a-bb83-102c91423bc9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.632092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.632853] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.633656] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.633656] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e269fb7-5662-434a-bb83-102c91423bc9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.916711] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: SUCCESS [ 1243.917083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.917172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.917417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.917513] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.030450] env[70032]: INFO networking_nsxv3.common.synchronization [None req-1794c545-f4d4-46fc-86b4-13a6fe64fc83 None None] Enqueued Resource ID: ae57c822-31eb-4042-b1ba-0866c8fb5705 with Priority: HIGHEST for action port [ 1244.030989] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae57c822-31eb-4042-b1ba-0866c8fb5705 with Priority: HIGHEST for action port [ 1244.031480] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae57c822-31eb-4042-b1ba-0866c8fb5705 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.031480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae57c822-31eb-4042-b1ba-0866c8fb5705" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.031480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae57c822-31eb-4042-b1ba-0866c8fb5705" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.031730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae57c822-31eb-4042-b1ba-0866c8fb5705" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.031812] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae57c822-31eb-4042-b1ba-0866c8fb5705',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.062432] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.063423] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.063548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.063621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.063813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.063903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.064105] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.064216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.064280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.064434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.064511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.064597] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a already deleted. [ 1244.064676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.136050] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.136302] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.136441] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.136757] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.137330] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.137330] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.137545] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.137640] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.137865] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.138019] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.138308] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.138463] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.138664] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.138885] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.139036] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.139183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 2e269fb7-5662-434a-bb83-102c91423bc9 is going to be updated. [ 1244.160049] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.162438] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.162438] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.162438] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.162438] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.162438] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.436852] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.437073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.437149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.437408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.437551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.437663] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 is going to be deleted. [ 1244.483345] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.483492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.483563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.483796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.483900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.484026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.529690] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 in Status: SUCCESS [ 1244.530023] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.530085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.530278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.530478] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.530604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.530669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.530822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.530902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.530992] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.534227] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae57c822-31eb-4042-b1ba-0866c8fb5705 [ 1244.534227] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.534227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.534227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.534227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.534227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.534227] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae57c822-31eb-4042-b1ba-0866c8fb5705 already deleted. [ 1244.534227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae57c822-31eb-4042-b1ba-0866c8fb5705" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.566038] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a: rpc.has_security_group_logging(os_id): False [ 1244.570890] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1244.571096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.571246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.571445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.571797] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.571797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.571933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.572014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.572104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.572235] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.581057] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.581208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.581275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.581424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.581509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.581724] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.581820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.581878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.582081] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.582118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.582185] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a is going to be created. [ 1244.598469] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a], does not exist path=[/infra/domains/default/groups/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a]."\n}' [ 1244.598600] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a [ 1244.598681] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1244.631649] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.631649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.631649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.631649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.632814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.632814] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.632814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.632814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.632814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.632814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.633688] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.633688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.633688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.633807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.633862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.633947] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a is going to be created. [ 1244.649283] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a], does not exist path=[/infra/domains/default/groups/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a [ 1244.649424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.649684] env[70032]: Traceback (most recent call last): [ 1244.649736] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1244.649736] env[70032]: return func(*args, **kwargs) [ 1244.649736] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1244.649736] env[70032]: res.raise_for_status() [ 1244.649736] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1244.649736] env[70032]: raise HTTPError(http_error_msg, response=self) [ 1244.649736] env[70032]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a [ 1244.649736] env[70032]: During handling of the above exception, another exception occurred: [ 1244.649736] env[70032]: Traceback (most recent call last): [ 1244.649736] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1244.649736] env[70032]: listener.cb(fileno) [ 1244.649736] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1244.649736] env[70032]: result = function(*args, **kwargs) [ 1244.649736] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1244.649736] env[70032]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1244.649736] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1244.649736] env[70032]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1244.649736] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1244.649736] env[70032]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1244.649736] env[70032]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1244.649736] env[70032]: res.raise_for_status() [ 1244.649736] env[70032]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1244.649736] env[70032]: raise HTTPError(http_error_msg, response=self) [ 1244.649736] env[70032]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6d2e1942-f6f2-4f7c-b365-5c216c5e4f0a [ 1244.650475] env[70032]: Removing descriptor: 61 [ 1244.757381] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531ad586-f734-4279-9db3-fc308558885e in Status: SUCCESS [ 1244.758337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.827616] env[70032]: INFO networking_nsxv3.common.synchronization [req-247fc8ea-e16e-4581-954a-a836dba281b6 req-d9a03a0b-f8d7-4c96-8a22-ce04a590311c service nova] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1244.827810] env[70032]: INFO networking_nsxv3.common.synchronization [req-247fc8ea-e16e-4581-954a-a836dba281b6 req-d9a03a0b-f8d7-4c96-8a22-ce04a590311c service nova] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1244.827952] env[70032]: INFO networking_nsxv3.common.synchronization [req-247fc8ea-e16e-4581-954a-a836dba281b6 req-d9a03a0b-f8d7-4c96-8a22-ce04a590311c service nova] Enqueued Resource ID: 2e269fb7-5662-434a-bb83-102c91423bc9 with Priority: HIGHEST for action port [ 1244.828864] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_rules [ 1244.828864] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1244.828864] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e269fb7-5662-434a-bb83-102c91423bc9 with Priority: HIGHEST for action port [ 1244.829221] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.829221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.829221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.829380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.829380] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.830291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.830291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.830474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.830565] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.830637] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.830727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.830789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.830968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.831068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.831156] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.831880] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e269fb7-5662-434a-bb83-102c91423bc9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.831968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.831998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.832152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.832223] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e269fb7-5662-434a-bb83-102c91423bc9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.032986] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.033168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.033227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.033445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.033534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.033733] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.033829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.033884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.034050] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.034145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.034236] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 is going to be deleted. [ 1245.060671] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.060815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.060945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.061209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.061323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.061448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.061613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.061771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.062085] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.062218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.062270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.062431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.062514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.062864] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('146e1b84-bae5-4992-b20b-a7c269ee2af9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.074400] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.334118] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.334260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.334434] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.337850] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e269fb7-5662-434a-bb83-102c91423bc9 with status ACTIVE [ 1245.338108] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.338227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.338295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.338498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.338920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.339154] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.339257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.339330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.339488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.339648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.339925] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.340034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.340102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.340242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.340879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.340879] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e269fb7-5662-434a-bb83-102c91423bc9 is going to be updated. [ 1245.359831] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.359831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.359831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.359831] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.360054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.360054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e269fb7-5662-434a-bb83-102c91423bc9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.564554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.564932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.564932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.565170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.565170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.565384] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.565539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.565628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.565764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.565869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.565977] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 146e1b84-bae5-4992-b20b-a7c269ee2af9 already deleted. [ 1245.566088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-146e1b84-bae5-4992-b20b-a7c269ee2af9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.576591] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.836688] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.078681] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.078875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.078924] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.079321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.079321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.079458] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1246.111163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.111285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.111326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.112048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.112048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.120778] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1246.338897] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.338897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.338897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.339161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.339161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.339333] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 is going to be updated. [ 1246.370374] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.370657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.370657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.370865] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.371056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.379911] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: IN_PROGRESS for 2s [ 1247.640685] env[70032]: INFO networking_nsxv3.common.synchronization [req-11164690-95eb-4967-88bd-00bcf6e8b43c req-b87fd345-577b-4ff1-88af-1724a003a8a5 tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_members [ 1247.641259] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGHEST for action security_group_members [ 1247.641667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.641667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.641804] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.641926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.642084] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.642182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.642244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.642392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.642478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.642566] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.128902] env[70032]: INFO networking_nsxv3.common.synchronization [req-df597ed1-87d6-43ae-ad42-0c3c1e1843dd req-07079a70-7056-4f2c-97c9-ef197eb4f06f tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1248.129278] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1248.129607] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.129750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.129818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.130184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.130344] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.130439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.130503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.130685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.130774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.130866] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.132234] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1248.132422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.132808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.132972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.133145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.133245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.133309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.133452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.133534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.133625] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.145026] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.145160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.145232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.145426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.169364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.169685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.169814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.169880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.170096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.170182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.170275] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 is going to be updated. [ 1248.206525] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.206682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.206731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.206945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.207324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.226975] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: IN_PROGRESS for 2s [ 1248.390184] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: SUCCESS [ 1248.390412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.391710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.392028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.392264] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.392449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.392699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.393064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.393198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.393537] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.393931] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.596346] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.596565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.596696] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.597095] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.597308] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.597471] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.597626] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.597877] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.598127] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.598260] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.598376] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.598488] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.598598] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.598720] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.598900] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.599141] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.618422] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.618593] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1248.618739] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.618923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.619276] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-ac69d033-5a14-417f-b8c1-274e3427301b taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.619456] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.619626] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.620120] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.620120] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac69d033-5a14-417f-b8c1-274e3427301b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.635185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.635322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.635408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.635610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.635705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.635900] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.636035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.636106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.636246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.636317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.636406] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c already deleted. [ 1248.636482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.637309] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.897284] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.122665] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.122877] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.122950] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.123272] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.123444] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.123602] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port ac69d033-5a14-417f-b8c1-274e3427301b not found, creating... [ 1249.123862] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.124049] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.124154] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.124421] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.124518] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.124807] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.124963] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.125098] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.125311] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.125458] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.125601] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: ac69d033-5a14-417f-b8c1-274e3427301b is going to be created. [ 1249.139271] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.146246] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.146450] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.146576] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.146833] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.147073] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.147300] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.401774] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd262fda-5bb7-40bc-b4f2-b2cdd0080c60: rpc.has_security_group_logging(os_id): False [ 1249.423540] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.424055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.424324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.424664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.449764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.449764] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.449764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.449764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.449764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.449764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.449764] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 is going to be updated. [ 1249.512022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.512022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.512022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.512022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.512022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.524034] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: IN_PROGRESS for 2s [ 1249.551030] env[70032]: INFO networking_nsxv3.common.synchronization [req-9f957723-c567-4d87-9a9d-bf29cecf0a32 req-eed1e097-4bb2-4781-86c0-a0f29829f37a tempest-ServerMetadataNegativeTestJSON-2114290645 tempest-ServerMetadataNegativeTestJSON-2114290645-project-member] Enqueued Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_members [ 1249.551030] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGHEST for action security_group_members [ 1249.552605] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.552803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.552947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.556714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.556988] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.557184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.557320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.557601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.557753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.557910] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.559843] env[70032]: INFO networking_nsxv3.common.synchronization [req-602904f8-7949-483d-ace4-5302418dc459 req-a8bf7022-8b78-4b4f-8246-dcd330bbae3e tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1249.563046] env[70032]: INFO networking_nsxv3.common.synchronization [req-602904f8-7949-483d-ace4-5302418dc459 req-a8bf7022-8b78-4b4f-8246-dcd330bbae3e tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1249.563308] env[70032]: INFO networking_nsxv3.common.synchronization [req-602904f8-7949-483d-ace4-5302418dc459 req-a8bf7022-8b78-4b4f-8246-dcd330bbae3e tempest-SecurityGroupsTestJSON-28641908 tempest-SecurityGroupsTestJSON-28641908-project-member] Enqueued Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_members [ 1249.564250] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 with Priority: HIGHEST for action security_group_members [ 1249.564786] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGHEST for action security_group_members [ 1249.564786] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f7eded-33f5-4584-a001-a880d502f14f with Priority: HIGHEST for action security_group_members [ 1249.565019] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.565305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.565478] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.565647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.565763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.568950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.569175] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.569292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.569376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.569593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.569708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.569771] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.571080] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f7eded-33f5-4584-a001-a880d502f14f taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.571080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.571164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.571415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.571415] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.571550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.571584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.571791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.571791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.571916] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f7eded-33f5-4584-a001-a880d502f14f',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.641997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.642225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.642307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.642527] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.642622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.642726] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1249.678788] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.678788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.679011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.679135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.679495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.688499] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1250.064495] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.064784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.064784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.064942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.073734] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.073873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.074097] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.074187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.086207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.086381] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.086624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.086624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.086851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.086986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.087175] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531ad586-f734-4279-9db3-fc308558885e is going to be updated. [ 1250.088754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.088968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.106925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.107210] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.107431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.107431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.107600] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.107681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.107754] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be updated. [ 1250.108679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.108843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.116581] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.116793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.116793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.117137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.117137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.124313] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531ad586-f734-4279-9db3-fc308558885e in Status: IN_PROGRESS for 2s [ 1250.130330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.130513] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.130645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.130708] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.130881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.130958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.131062] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f7eded-33f5-4584-a001-a880d502f14f is going to be updated. [ 1250.132938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.133067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.133164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.133280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.133396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.141233] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: IN_PROGRESS for 2s [ 1250.144471] env[70032]: INFO networking_nsxv3.common.synchronization [req-df597ed1-87d6-43ae-ad42-0c3c1e1843dd req-88823ed8-62f8-4f2b-834c-de7ccc06bb7e service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1250.144471] env[70032]: INFO networking_nsxv3.common.synchronization [req-df597ed1-87d6-43ae-ad42-0c3c1e1843dd req-88823ed8-62f8-4f2b-834c-de7ccc06bb7e service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1250.144471] env[70032]: INFO networking_nsxv3.common.synchronization [req-df597ed1-87d6-43ae-ad42-0c3c1e1843dd req-88823ed8-62f8-4f2b-834c-de7ccc06bb7e service nova] Enqueued Resource ID: ac69d033-5a14-417f-b8c1-274e3427301b with Priority: HIGHEST for action port [ 1250.144471] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1250.144471] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1250.144471] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac69d033-5a14-417f-b8c1-274e3427301b with Priority: HIGHEST for action port [ 1250.144867] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.144931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.144966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.145212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.145292] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.146106] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.146218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.146300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.146456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.147245] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.147245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.147245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.147245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.147245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.147245] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.147738] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac69d033-5a14-417f-b8c1-274e3427301b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.147832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.147934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.148054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.148130] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac69d033-5a14-417f-b8c1-274e3427301b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.178029] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.178205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.178288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.178493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.178628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.191379] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: IN_PROGRESS for 2s [ 1250.240653] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d43c7c-82c8-4a83-8478-40e297491039 in Status: SUCCESS [ 1250.240827] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 deletion is rescheduled due to dependency. [ 1250.240939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.650043] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.650252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.651426] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.652349] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac69d033-5a14-417f-b8c1-274e3427301b with status ACTIVE [ 1250.653189] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.653189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.653189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.653189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.653189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.653393] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.653393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.653393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.653499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.653575] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.653754] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.653840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.653900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.654077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.654154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.654239] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac69d033-5a14-417f-b8c1-274e3427301b is going to be updated. [ 1250.684253] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.684429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.684522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.684758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.684922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.685132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac69d033-5a14-417f-b8c1-274e3427301b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.157110] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.541287] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: SUCCESS [ 1251.541287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.659530] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.659530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.659530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.659753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.659753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.659815] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be created. [ 1251.685895] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.685895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.685895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.685895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.685895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.699692] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1251.699853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.700049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.700260] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.700459] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.700587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.700653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.700871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.700975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.701100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.701198] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.702287] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: UNINITIALIZED for 2s [ 1251.702413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.702583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.702747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.702860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.702953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.703153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.703233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.703324] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.138730] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531ad586-f734-4279-9db3-fc308558885e in Status: SUCCESS [ 1252.138730] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531ad586-f734-4279-9db3-fc308558885e deletion is rescheduled due to dependency. [ 1252.138730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.152616] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c in Status: SUCCESS [ 1252.152616] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c deletion is rescheduled due to dependency. [ 1252.152616] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.208763] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f7eded-33f5-4584-a001-a880d502f14f in Status: SUCCESS [ 1252.208763] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f7eded-33f5-4584-a001-a880d502f14f deletion is rescheduled due to dependency. [ 1252.208763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f7eded-33f5-4584-a001-a880d502f14f" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.208763] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.208763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.208763] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.208763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.208763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.208763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.236832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.237144] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.238046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.238046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.238046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.238046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.238046] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1252.267869] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.267869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.267869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.267869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.267869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.277251] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1252.459400] env[70032]: INFO networking_nsxv3.common.synchronization [None req-705fcc30-5340-4b36-b4eb-4c33627541d4 tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_rules [ 1252.460278] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_rules [ 1252.460477] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.461198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.461269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.461547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.461638] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.592909] env[70032]: INFO networking_nsxv3.common.synchronization [None req-63fd1a82-c372-416d-a4e8-3a255a88bde0 tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_rules [ 1252.593799] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_rules [ 1252.593799] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.593938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.991956] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.991956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.991956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.991956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.991956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.991956] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa already deleted. [ 1252.991956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.991956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.991956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.991956] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.035473] env[70032]: INFO networking_nsxv3.common.synchronization [None req-b1f86485-a12c-4824-a608-30af0c97f9bc tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_rules [ 1253.035473] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_rules [ 1253.036795] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.037158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.037389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.037812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.038914] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.180817] env[70032]: INFO networking_nsxv3.common.synchronization [None req-3d997de7-ee6f-4678-8d4a-4ad9d245de2a tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_rules [ 1253.181355] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_rules [ 1253.181666] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.181768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.520163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.520443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.520443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.520529] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.520585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.520678] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa already deleted. [ 1253.520761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.558561] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.558717] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.558784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.559077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.559149] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.559268] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 already deleted. [ 1253.559331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.559453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.559624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.559709] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.711082] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1253.711309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.711467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.711681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.711872] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.712014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.712082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.712214] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.712296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.712383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.712472] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.079221] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.079412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.079452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.079752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.079976] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.079976] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 already deleted. [ 1254.080118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.215252] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.215397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.215467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.215680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.215840] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.215935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.215998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.216160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.216261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.216351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.216498] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.216588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.216647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.216785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.216918] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.217016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.217082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.217207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.217270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.217346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.217432] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.286388] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1254.286617] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 deletion is rescheduled due to dependency. [ 1254.286685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.286834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.287064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.287250] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.287440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.287440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.287703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.287789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.287905] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.719919] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3009f70d-c184-49eb-851b-1a0b6b0a658c: rpc.has_security_group_logging(os_id): False [ 1254.737885] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.737885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.738115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.738233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.738323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.738549] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.738645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.738709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.738875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.738958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.739298] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.739445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.739445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.739603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.739771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.739915] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.740041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.740117] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.740301] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.740423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.740559] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be created. [ 1254.789868] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.790142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.790276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.790598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.790790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.791022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.791122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.791172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.791442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.791586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.791721] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1254.795042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.795172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.795210] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.795380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.795624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.806192] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1254.816507] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.816811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.816956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.817317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.817576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.830211] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1256.818418] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1256.818667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.838685] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1256.838914] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 deletion is rescheduled due to dependency. [ 1256.839047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.839208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.839428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.839612] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.840157] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.840262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.840435] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.840516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.840605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.840863] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-30009369-6f19-4944-a9ac-97ee4f709ca2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.840974] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.841043] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.841187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.841324] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.841428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.841463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.841619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.841699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.841777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.841861] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.344767] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30009369-6f19-4944-a9ac-97ee4f709ca2: rpc.has_security_group_logging(os_id): False [ 1257.363472] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.363667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.363770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.364016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.364125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.364483] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.364593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.364658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.364820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.364979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.365218] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.365317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.365379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.365522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.365598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.365782] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.365875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.365934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.366203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.366284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.366373] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be updated. [ 1257.424154] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.424310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.424381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.424597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.424994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.437783] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: IN_PROGRESS for 2s [ 1258.182429] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1258.182731] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1258.442170] env[70032]: INFO networking_nsxv3.common.synchronization [None req-5b401924-954e-4098-accd-f39c96ca51e2 None None] Enqueued Resource ID: b80e0b9e-c845-4601-a482-4339bc5a0559 with Priority: HIGHEST for action port [ 1258.444266] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b80e0b9e-c845-4601-a482-4339bc5a0559 with Priority: HIGHEST for action port [ 1258.444266] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-b80e0b9e-c845-4601-a482-4339bc5a0559 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.445767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b80e0b9e-c845-4601-a482-4339bc5a0559" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.445895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b80e0b9e-c845-4601-a482-4339bc5a0559" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.446212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b80e0b9e-c845-4601-a482-4339bc5a0559" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.446306] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80e0b9e-c845-4601-a482-4339bc5a0559',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.950094] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b80e0b9e-c845-4601-a482-4339bc5a0559 [ 1258.950094] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.950094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.950094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.950094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.950094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.950094] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b80e0b9e-c845-4601-a482-4339bc5a0559 already deleted. [ 1258.950094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b80e0b9e-c845-4601-a482-4339bc5a0559" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.413646] env[70032]: INFO networking_nsxv3.common.synchronization [req-71fe1c86-57dc-4eb9-a5f9-ac9da81cbd88 req-34300e7f-92aa-42d7-9d34-0318ca531a71 tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_members [ 1259.414362] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_members [ 1259.414539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.414665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.414729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.415047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.415155] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.415267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.418896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.418896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.418896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.418896] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.424690] env[70032]: INFO networking_nsxv3.common.synchronization [None req-d5b28ddb-9253-4e41-b1e4-dd41206d762d tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_rules [ 1259.424690] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_rules [ 1259.424690] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.424690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.424690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.424690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.424690] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.453685] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 in Status: SUCCESS [ 1259.453937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.454166] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.454378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.454474] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.549153] env[70032]: INFO networking_nsxv3.common.synchronization [None req-07e40719-481e-4b06-9487-082a560533cd tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_rules [ 1259.550888] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_rules [ 1259.550888] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.550888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.789042] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.789042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.789042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.789042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.789042] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.789042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.789522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.789821] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.789980] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.790224] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.790350] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.790460] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.790579] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.790786] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1259.790900] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.791068] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.808364] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.808547] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1259.808695] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.808888] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-119" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.809240] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-8ab02625-5caf-4b24-a33d-7faf3e1e935e taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.809443] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.809554] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.809925] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.810103] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ab02625-5caf-4b24-a33d-7faf3e1e935e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.918208] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.918746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.918909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.919185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.919331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.919579] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.919791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.919888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.920103] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.920238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.920369] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa already deleted. [ 1259.920493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.945432] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.945614] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.945653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.945860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.945954] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.946065] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 already deleted. [ 1259.946151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.946303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.946475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.946605] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.971942] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.971942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.972372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.972649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.972796] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.972947] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 is going to be deleted. [ 1260.021527] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.021669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.021737] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.022364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.022364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.022364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.022364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.022558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.022558] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.313199] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.316018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 8ab02625-5caf-4b24-a33d-7faf3e1e935e not found, creating... [ 1260.316018] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.316018] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.316406] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.316406] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.316724] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.317069] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.318519] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.318519] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 8ab02625-5caf-4b24-a33d-7faf3e1e935e is going to be created. [ 1260.337880] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.337880] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.337880] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.338095] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.338132] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.338874] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.349364] env[70032]: INFO networking_nsxv3.common.synchronization [None req-70aa732f-21fa-4bcd-9d92-ef1a43c99b12 None None] Enqueued Resource ID: 76ecfd35-a51e-40ee-8524-4158a29cd96b with Priority: HIGHEST for action port [ 1260.349364] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ecfd35-a51e-40ee-8524-4158a29cd96b with Priority: HIGHEST for action port [ 1260.349968] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-76ecfd35-a51e-40ee-8524-4158a29cd96b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.349968] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76ecfd35-a51e-40ee-8524-4158a29cd96b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.350082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76ecfd35-a51e-40ee-8524-4158a29cd96b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.350494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76ecfd35-a51e-40ee-8524-4158a29cd96b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.350494] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ecfd35-a51e-40ee-8524-4158a29cd96b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.467508] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.467845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.467845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.467991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.468094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.468195] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 already deleted. [ 1260.468275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.551183] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.551347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.551414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.551645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.551738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.551849] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 already deleted. [ 1260.551944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.552740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.552805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.552903] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30009369-6f19-4944-a9ac-97ee4f709ca2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.853557] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76ecfd35-a51e-40ee-8524-4158a29cd96b [ 1260.853837] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.853993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.853993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.854198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.854293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.854377] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76ecfd35-a51e-40ee-8524-4158a29cd96b already deleted. [ 1260.854450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76ecfd35-a51e-40ee-8524-4158a29cd96b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.046714] env[70032]: INFO networking_nsxv3.common.synchronization [req-71fe1c86-57dc-4eb9-a5f9-ac9da81cbd88 req-0ca12f50-b210-4ae5-9c4e-365c520c52a9 service nova] Enqueued Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_rules [ 1261.046915] env[70032]: INFO networking_nsxv3.common.synchronization [req-71fe1c86-57dc-4eb9-a5f9-ac9da81cbd88 req-0ca12f50-b210-4ae5-9c4e-365c520c52a9 service nova] Enqueued Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_members [ 1261.047108] env[70032]: INFO networking_nsxv3.common.synchronization [req-71fe1c86-57dc-4eb9-a5f9-ac9da81cbd88 req-0ca12f50-b210-4ae5-9c4e-365c520c52a9 service nova] Enqueued Resource ID: 8ab02625-5caf-4b24-a33d-7faf3e1e935e with Priority: HIGHEST for action port [ 1261.047332] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_rules [ 1261.047426] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_members [ 1261.047541] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab02625-5caf-4b24-a33d-7faf3e1e935e with Priority: HIGHEST for action port [ 1261.048120] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.048270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.048311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.048495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.048575] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.049418] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.049498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.049585] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.049785] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.049931] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.050583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.050583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.050583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.050583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.050583] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.051353] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ab02625-5caf-4b24-a33d-7faf3e1e935e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.051463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.051532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.051683] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.051758] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ab02625-5caf-4b24-a33d-7faf3e1e935e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.072895] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.073054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.073126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.073443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.073443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.073543] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30009369-6f19-4944-a9ac-97ee4f709ca2 already deleted. [ 1261.073576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30009369-6f19-4944-a9ac-97ee4f709ca2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.556206] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.556535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.556535] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.557475] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ab02625-5caf-4b24-a33d-7faf3e1e935e with status ACTIVE [ 1261.557735] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.557853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.557911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.559146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.559146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.559146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.559525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.559525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.559525] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ab02625-5caf-4b24-a33d-7faf3e1e935e is going to be updated. [ 1261.580066] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.580254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.580354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.580567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.580703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.580858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ab02625-5caf-4b24-a33d-7faf3e1e935e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.606252] env[70032]: INFO networking_nsxv3.common.synchronization [req-c9667aeb-76b4-4696-9790-a39bd2bd061a req-9b4eec24-ddeb-41dc-b7a7-3964baa2211a tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_members [ 1261.606761] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_members [ 1261.607092] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.607220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.607285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.607517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.607668] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.607773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.607810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.607964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.608061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.608402] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.951148] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.951417] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.951575] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.951911] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.952358] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.952562] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.952706] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.953012] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.953211] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.953461] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.953617] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1261.953739] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1261.953888] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1261.954028] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.954177] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1261.954349] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1261.973013] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1261.973211] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1261.973575] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1261.973575] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.973886] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.974092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.974237] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.974576] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.974722] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2de1d582-a96b-45f8-b5ff-bdf4ebe52200',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.061685] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.109677] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.109881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.109960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.110186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.110278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.110479] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.110577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.110640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.110784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.110862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.110952] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 already deleted. [ 1262.111038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.476503] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.476732] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.476868] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.477191] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.477355] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.477520] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 2de1d582-a96b-45f8-b5ff-bdf4ebe52200 not found, creating... [ 1262.477827] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.477995] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.478138] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.478466] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.478624] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.478916] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.479092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.479217] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.479432] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.479573] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.479735] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 2de1d582-a96b-45f8-b5ff-bdf4ebe52200 is going to be created. [ 1262.497739] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.498206] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.498206] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.498543] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.498838] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.499109] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.564064] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.564437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.564437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.564508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.564597] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.564699] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa is going to be created. [ 1262.596456] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.596690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.596793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.597096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.597334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.609551] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bc461d7-4f61-4222-8718-50d24f7845aa in Status: UNINITIALIZED for 2s [ 1263.204442] env[70032]: INFO networking_nsxv3.common.synchronization [req-c9667aeb-76b4-4696-9790-a39bd2bd061a req-e3b87e52-668d-47b7-8fd8-5c1bf7c387c6 service nova] Enqueued Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_rules [ 1263.204442] env[70032]: INFO networking_nsxv3.common.synchronization [req-c9667aeb-76b4-4696-9790-a39bd2bd061a req-e3b87e52-668d-47b7-8fd8-5c1bf7c387c6 service nova] Enqueued Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_members [ 1263.204442] env[70032]: INFO networking_nsxv3.common.synchronization [req-c9667aeb-76b4-4696-9790-a39bd2bd061a req-e3b87e52-668d-47b7-8fd8-5c1bf7c387c6 service nova] Enqueued Resource ID: 2de1d582-a96b-45f8-b5ff-bdf4ebe52200 with Priority: HIGHEST for action port [ 1263.204666] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_rules [ 1263.204790] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_members [ 1263.204876] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2de1d582-a96b-45f8-b5ff-bdf4ebe52200 with Priority: HIGHEST for action port [ 1263.205434] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.205607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.205607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.206739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.206739] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.207374] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.207374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.207374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.207374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.207747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.207871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.207904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.208046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.208239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.208368] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.210254] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.210254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.210413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.210445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.210514] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2de1d582-a96b-45f8-b5ff-bdf4ebe52200',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.712938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.713277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.713277] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.714174] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2de1d582-a96b-45f8-b5ff-bdf4ebe52200 with status ACTIVE [ 1263.714360] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.714477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.714544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.714741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.714834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.715015] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.715115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.715176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.715333] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.715412] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.715589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.715681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.715740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.715878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.715953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.716045] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2de1d582-a96b-45f8-b5ff-bdf4ebe52200 is going to be updated. [ 1263.736050] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.736187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.736245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.736428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.736558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.736713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2de1d582-a96b-45f8-b5ff-bdf4ebe52200" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.217884] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.618918] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bc461d7-4f61-4222-8718-50d24f7845aa in Status: SUCCESS [ 1264.619152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.619382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.619598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.619842] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.619962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.620041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.620200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.620280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.620365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.620454] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.720062] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.720391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.720391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.720488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.720552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.720650] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 is going to be created. [ 1264.743592] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.743726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.743770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.743930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.744088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.751920] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 in Status: UNINITIALIZED for 2s [ 1265.122774] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.627063] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bc461d7-4f61-4222-8718-50d24f7845aa: rpc.has_security_group_logging(os_id): False [ 1265.648137] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.648462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.648462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.648822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.648822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.649035] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.649126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.649291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.649589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.649589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.649589] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa is going to be created. [ 1265.727106] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.727484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.727484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.727746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.727960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.738585] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bc461d7-4f61-4222-8718-50d24f7845aa in Status: IN_PROGRESS for 2s [ 1266.029216] env[70032]: INFO networking_nsxv3.common.synchronization [req-1adbcfb3-2baf-4093-8652-85dac1841e6e req-a62c5593-bd8e-436c-b197-d962e8848b71 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_members [ 1266.029874] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_members [ 1266.030064] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.030191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.030252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.030501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.030655] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.030755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.030813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.030997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.031099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.031190] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.355094] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.355259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.355382] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.355657] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.355929] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.356177] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.356318] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.356545] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.356702] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.356913] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.357045] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.357162] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.357275] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.357391] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.357501] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.357638] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.375588] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.375803] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1266.375989] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.376259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.376606] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-d51844eb-a704-40f5-8649-917c381b8fb9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.376821] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.376975] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.377337] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.377523] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51844eb-a704-40f5-8649-917c381b8fb9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.533470] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.533637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.533712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.533923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.534031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.534228] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.534325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.534387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.534530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.534604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.534689] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 already deleted. [ 1266.534768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.761761] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 in Status: SUCCESS [ 1266.762124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.762192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.762345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.762527] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.762639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.762703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.762848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.762933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.763028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.763121] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.879830] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.880028] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.880140] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.880445] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.880670] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.880785] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port d51844eb-a704-40f5-8649-917c381b8fb9 not found, creating... [ 1266.881146] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.881292] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.881417] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.881719] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.881785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.882108] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.882277] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.882400] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.882611] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.882754] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.882899] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: d51844eb-a704-40f5-8649-917c381b8fb9 is going to be created. [ 1266.901220] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.901415] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.901541] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.901781] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.902013] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.902306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.265458] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.638578] env[70032]: INFO networking_nsxv3.common.synchronization [req-1adbcfb3-2baf-4093-8652-85dac1841e6e req-de859428-4c49-41bf-b7ff-301b76b16317 service nova] Enqueued Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_rules [ 1267.638777] env[70032]: INFO networking_nsxv3.common.synchronization [req-1adbcfb3-2baf-4093-8652-85dac1841e6e req-de859428-4c49-41bf-b7ff-301b76b16317 service nova] Enqueued Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_members [ 1267.638922] env[70032]: INFO networking_nsxv3.common.synchronization [req-1adbcfb3-2baf-4093-8652-85dac1841e6e req-de859428-4c49-41bf-b7ff-301b76b16317 service nova] Enqueued Resource ID: d51844eb-a704-40f5-8649-917c381b8fb9 with Priority: HIGHEST for action port [ 1267.639444] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_rules [ 1267.639582] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_members [ 1267.639678] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51844eb-a704-40f5-8649-917c381b8fb9 with Priority: HIGHEST for action port [ 1267.640022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.640151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.640217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.640418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.640506] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.643042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.643042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.643042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.643042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.643042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.643042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.643042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.643042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.643042] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.643042] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.643720] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-d51844eb-a704-40f5-8649-917c381b8fb9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.643720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.643720] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.644125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.644125] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51844eb-a704-40f5-8649-917c381b8fb9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.758613] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bc461d7-4f61-4222-8718-50d24f7845aa in Status: SUCCESS [ 1267.758759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.767228] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a593b272-d3dd-4035-9c2e-1bb9cca70df6: rpc.has_security_group_logging(os_id): False [ 1267.784432] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.784617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.784617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.784846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.784942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.785195] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.785297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.785362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.785521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.785599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.785685] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 is going to be created. [ 1267.838676] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.838860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.838860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.839079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.839261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.848958] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 in Status: IN_PROGRESS for 2s [ 1268.142400] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.142577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.146895] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.147055] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d51844eb-a704-40f5-8649-917c381b8fb9 with status ACTIVE [ 1268.147142] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.147265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.147352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.147664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.147822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.148121] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.148288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.148390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.148654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.148797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.149125] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.149288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.149390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.149610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.149734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.149882] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d51844eb-a704-40f5-8649-917c381b8fb9 is going to be updated. [ 1268.172458] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.172657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.172657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.172844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.172978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.173154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d51844eb-a704-40f5-8649-917c381b8fb9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.302424] env[70032]: INFO networking_nsxv3.common.synchronization [req-50202fa7-6a21-4f32-bc30-9c8246ac6cb6 req-87ccd176-09a3-46d6-8318-94ff6cbd303c tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1268.302927] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1268.303242] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.303360] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.303426] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.303621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.303773] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.303871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.303935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.304221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.304388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.304455] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.630930] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.631147] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.631275] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.631546] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.631810] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.631967] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.632368] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.632615] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.632767] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.632979] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.633104] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1268.633214] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1268.633322] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1268.633431] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.633535] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1268.633669] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1268.652727] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.657962] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1268.658879] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1268.658879] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1268.658879] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.659086] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-7592f471-00f5-4438-b005-ac6e02bbcd4d taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.659223] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.659346] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.659721] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.659960] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7592f471-00f5-4438-b005-ac6e02bbcd4d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.806421] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.155885] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.156118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.156222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.156433] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.156532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.156637] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 is going to be created. [ 1269.163415] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.163415] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.163700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.164041] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.164262] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.164483] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 7592f471-00f5-4438-b005-ac6e02bbcd4d not found, creating... [ 1269.164887] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.165134] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.165321] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.165621] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.165820] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.166216] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.166310] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.166433] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.166653] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.166797] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.166943] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 7592f471-00f5-4438-b005-ac6e02bbcd4d is going to be created. [ 1269.183855] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.184033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.184104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.184308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.184465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.188196] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.188407] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.188550] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.188802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.189027] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.189275] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.193921] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: UNINITIALIZED for 2s [ 1269.308441] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.810964] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.811365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.811365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.811476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.811628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.811756] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1269.838042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.838422] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.838534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.838696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.838842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.847412] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1269.860216] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 in Status: SUCCESS [ 1269.860216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.488911] env[70032]: INFO networking_nsxv3.common.synchronization [req-50202fa7-6a21-4f32-bc30-9c8246ac6cb6 req-7b84021e-3323-48de-97b3-6faedbd74a85 service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1270.489120] env[70032]: INFO networking_nsxv3.common.synchronization [req-50202fa7-6a21-4f32-bc30-9c8246ac6cb6 req-7b84021e-3323-48de-97b3-6faedbd74a85 service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1270.489292] env[70032]: INFO networking_nsxv3.common.synchronization [req-50202fa7-6a21-4f32-bc30-9c8246ac6cb6 req-7b84021e-3323-48de-97b3-6faedbd74a85 service nova] Enqueued Resource ID: 7592f471-00f5-4438-b005-ac6e02bbcd4d with Priority: HIGHEST for action port [ 1270.489492] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1270.489622] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1270.489715] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7592f471-00f5-4438-b005-ac6e02bbcd4d with Priority: HIGHEST for action port [ 1270.490338] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.490487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.490540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.490722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.490817] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.491615] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.491745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.491892] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-7592f471-00f5-4438-b005-ac6e02bbcd4d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.491989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.492063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.492292] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.492366] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7592f471-00f5-4438-b005-ac6e02bbcd4d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.993917] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.994341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.998374] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7592f471-00f5-4438-b005-ac6e02bbcd4d with status ACTIVE [ 1270.998374] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.998374] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.998374] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.998374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.998374] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7592f471-00f5-4438-b005-ac6e02bbcd4d is going to be updated. [ 1271.018282] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.018517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.018517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.018661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.018787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.018934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7592f471-00f5-4438-b005-ac6e02bbcd4d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.204419] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: SUCCESS [ 1271.204673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.204853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.205093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.205296] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.205434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.205487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.205628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.205706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.205790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.205879] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.708134] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.856212] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1271.856442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.856602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.856808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.856999] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.857131] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.857194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.857347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.857449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.857515] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.209967] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e992527-e74e-4251-a2db-cbb2515a8605: rpc.has_security_group_logging(os_id): False [ 1272.226780] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.226918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.227020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.227312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.227366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.227580] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.227681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.227752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.227910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.227942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.228049] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 is going to be created. [ 1272.312153] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.312407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.312407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.312576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.312756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.322626] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: IN_PROGRESS for 2s [ 1272.360436] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.862224] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.364702] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.365196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.365196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.365196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.365335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.365335] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1273.393400] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.393551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.393656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.393809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.393952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.402748] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1274.335018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: SUCCESS [ 1274.335247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.412315] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1275.412663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.412663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.412882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.413234] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.413446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.413446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.413560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.413604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.413713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.413766] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.490388] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.490661] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1275.915583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.915748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.915798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.916018] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.916185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.916290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.916356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.916511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.916602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.916689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.916836] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.917053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.917053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.917141] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.917266] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.917358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.917419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.917556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.917644] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.917710] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.917859] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.420746] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3009f70d-c184-49eb-851b-1a0b6b0a658c: rpc.has_security_group_logging(os_id): False [ 1276.438279] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.438598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.438598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.438758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.439400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.439400] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.439400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.439400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.439400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.440089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.440089] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.440089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.440089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.440089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.440089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.440476] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.440476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.440476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.440586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.440679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.440758] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1276.497634] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.497973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.497973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.498172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.498323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.509243] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1278.522765] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1278.523158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.492091] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.492371] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.873416] env[70032]: INFO networking_nsxv3.common.synchronization [req-94f120b7-eac3-4606-9d10-01f0dd62c3e1 req-1aa0c025-065e-41b6-9afc-4bfd37eed475 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1281.874159] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1281.874636] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.874820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.874936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.875256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.875588] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.875654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.875757] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.875982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.876143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.876497] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.380094] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.882813] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.943064] env[70032]: INFO networking_nsxv3.common.synchronization [req-69cec25c-fa30-4589-84d7-b76b61f64c2e req-eedcc0fe-925d-45a7-a6e8-50c45e05f9f8 tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1282.943648] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1282.943985] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.944145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.944245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.944494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.944651] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.944752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.944812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.944964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.945086] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.945190] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.179696] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.179905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.180111] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.180392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.180655] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.180814] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.180937] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.181225] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.181383] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.181590] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1283.181705] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1283.181816] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1283.181926] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1283.182049] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1283.182161] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1283.182290] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1283.201418] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1283.201569] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1283.201703] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1283.201869] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.202170] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.202334] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.202453] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.202740] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.202876] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a332e1c7-205e-4c74-bcf0-4f206cf7e68c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.385223] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.385437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.385498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.385660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.385750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.385849] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1283.414168] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.414349] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.414395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.414601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.414749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.422688] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1283.448682] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.448871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.448871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.449106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.449200] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.449396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.449494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.449555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.449709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.449787] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.449872] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 already deleted. [ 1283.450024] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.704810] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.704983] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.704983] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.705370] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.705541] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.705735] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a332e1c7-205e-4c74-bcf0-4f206cf7e68c not found, creating... [ 1283.706152] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.706315] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.706524] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.706800] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.709031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.709031] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.709031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.709031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.709031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.709031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.709031] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a332e1c7-205e-4c74-bcf0-4f206cf7e68c is going to be created. [ 1283.727622] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.727844] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.728373] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.728373] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.728573] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.728796] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.400563] env[70032]: INFO networking_nsxv3.common.synchronization [req-69cec25c-fa30-4589-84d7-b76b61f64c2e req-1b5aab9b-3a24-4aab-a2dd-d6d50e9dcbec service nova] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_rules [ 1284.400860] env[70032]: INFO networking_nsxv3.common.synchronization [req-69cec25c-fa30-4589-84d7-b76b61f64c2e req-1b5aab9b-3a24-4aab-a2dd-d6d50e9dcbec service nova] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1284.400915] env[70032]: INFO networking_nsxv3.common.synchronization [req-69cec25c-fa30-4589-84d7-b76b61f64c2e req-1b5aab9b-3a24-4aab-a2dd-d6d50e9dcbec service nova] Enqueued Resource ID: a332e1c7-205e-4c74-bcf0-4f206cf7e68c with Priority: HIGHEST for action port [ 1284.401474] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_rules [ 1284.401613] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1284.401709] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a332e1c7-205e-4c74-bcf0-4f206cf7e68c with Priority: HIGHEST for action port [ 1284.401979] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.405257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.405329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.405653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.405727] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.406703] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.406821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.406902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.407137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.407296] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.407385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.407441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.407601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.407696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.407789] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.408969] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.409094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.409162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.409316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.409407] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a332e1c7-205e-4c74-bcf0-4f206cf7e68c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.911531] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.911531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.911844] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.912653] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a332e1c7-205e-4c74-bcf0-4f206cf7e68c with status ACTIVE [ 1284.912845] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.912962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.913038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.913245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.913337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.913509] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.913603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.913663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.913812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.913889] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.914084] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.914178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.914237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.914376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.914451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.914534] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a332e1c7-205e-4c74-bcf0-4f206cf7e68c is going to be updated. [ 1284.933242] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.933442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.933442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.933648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.933777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.933962] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a332e1c7-205e-4c74-bcf0-4f206cf7e68c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.416967] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.432997] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1285.433226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.919249] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.919457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.919457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.919668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.919763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.919862] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be created. [ 1285.942031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.942257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.942257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.942467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.942618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.951302] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: UNINITIALIZED for 2s [ 1287.962519] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: SUCCESS [ 1287.962930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.962930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.963102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.963299] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.963418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.963510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.963635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.963714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.963842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.963908] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.466414] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.466414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.466414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.466649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.466649] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.466738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.466828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.466927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.467022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.467112] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.467338] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.467338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.467472] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.467557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.467667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.467757] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.467812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.467966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.468062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.468146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.468230] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.970765] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f5dd232-e552-483f-8e40-b495ebe5e511: rpc.has_security_group_logging(os_id): False [ 1288.988520] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.988722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.988722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.988937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.989076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.989258] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.989372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.989420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.989580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.989662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.989844] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.989939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.990013] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.990198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.990275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.990453] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.990545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.990605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.990740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.990816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.990902] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be created. [ 1289.058860] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.059057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.059106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.059284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.059458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.071905] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: IN_PROGRESS for 2s [ 1289.402433] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.402556] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1291.088999] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: SUCCESS [ 1291.089388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.298884] env[70032]: INFO networking_nsxv3.common.synchronization [req-96f9c8e1-3d80-47b0-bfe1-c55167a1d927 req-c936dede-ef79-4aed-b345-2b1ee8b2731a tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1294.302427] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1294.302427] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.302427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.302427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.302427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.302427] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.302427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.302427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.302427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.302427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.302427] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.561332] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.561516] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.561611] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.561899] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.562281] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.562453] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.562525] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.562735] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.562881] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.563105] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.563227] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.563599] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.563599] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.563599] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.563795] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.563795] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.584098] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.584288] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1294.584442] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.584623] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.584945] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-9327bd23-d05e-4c5d-87e0-c23f32899851 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.585141] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.585276] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.585628] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.585770] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9327bd23-d05e-4c5d-87e0-c23f32899851',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.803048] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.088807] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.088807] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.088807] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.089064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.089237] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.089399] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 9327bd23-d05e-4c5d-87e0-c23f32899851 not found, creating... [ 1295.089660] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.089917] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.090011] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.090199] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.090350] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.090645] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.090839] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.090932] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.091155] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.091294] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.092061] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 9327bd23-d05e-4c5d-87e0-c23f32899851 is going to be created. [ 1295.109556] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.109690] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.109816] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.110059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.110319] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.110544] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.305346] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.790521] env[70032]: INFO networking_nsxv3.common.synchronization [req-96f9c8e1-3d80-47b0-bfe1-c55167a1d927 req-146b50ff-9ec7-4717-90d5-0dff5075fbf9 service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1295.790713] env[70032]: INFO networking_nsxv3.common.synchronization [req-96f9c8e1-3d80-47b0-bfe1-c55167a1d927 req-146b50ff-9ec7-4717-90d5-0dff5075fbf9 service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1295.790856] env[70032]: INFO networking_nsxv3.common.synchronization [req-96f9c8e1-3d80-47b0-bfe1-c55167a1d927 req-146b50ff-9ec7-4717-90d5-0dff5075fbf9 service nova] Enqueued Resource ID: 9327bd23-d05e-4c5d-87e0-c23f32899851 with Priority: HIGHEST for action port [ 1295.791128] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1295.791271] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1295.791369] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327bd23-d05e-4c5d-87e0-c23f32899851 with Priority: HIGHEST for action port [ 1295.791949] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.792137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.792235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.792442] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.792525] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.793765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.793996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.794219] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-9327bd23-d05e-4c5d-87e0-c23f32899851 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.794335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.794395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.794554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.794630] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9327bd23-d05e-4c5d-87e0-c23f32899851',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.807289] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.807425] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.807473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.807655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.807742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.807837] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1295.845706] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.845885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.845950] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.846116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.846257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.858077] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1296.294902] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.295146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.296423] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9327bd23-d05e-4c5d-87e0-c23f32899851 with status ACTIVE [ 1296.296590] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.296711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.296797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.297049] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.297164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.297371] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.297935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.298019] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.298235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.298331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.298560] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.298688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.298762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.298912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.298993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.299122] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9327bd23-d05e-4c5d-87e0-c23f32899851 is going to be updated. [ 1296.317642] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.317917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.317917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.318068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.318216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.318387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9327bd23-d05e-4c5d-87e0-c23f32899851" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.867726] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1297.868089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.868308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.868612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.868899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.869104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.869229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.869482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.869624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.869782] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.374650] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.876719] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.379060] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.379247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.379325] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.379589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.379686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.379803] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1299.406829] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.406829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.406829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.407101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.407101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.414981] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1300.770825] env[70032]: INFO networking_nsxv3.common.synchronization [req-1a2b24f6-f2e8-4af7-9812-07abc0e45e9e req-fc9e5a3e-1a44-4dfe-8e3e-1a46851d477c tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1300.771195] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1300.771475] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.771589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.771646] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.771815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.771968] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.772078] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.772137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.772285] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.772449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.772449] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.274677] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.274904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.274904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.275146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.293745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.293975] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.294113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.294177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.294356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.294451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.294530] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1301.316573] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.316715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.316759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.316904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.317034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.323892] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1301.424914] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1301.425167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.425322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.425569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.426185] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.426185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.426185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.426470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.426470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.426470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.426470] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.929189] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.929189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.929189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.929189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.929553] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.929553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.929553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.929754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.929754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.929822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.929940] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.930045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.930108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.930329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.930482] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.930579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.930639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.930779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.930856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.930939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.931037] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.433766] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3009f70d-c184-49eb-851b-1a0b6b0a658c: rpc.has_security_group_logging(os_id): False [ 1302.451430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.451430] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.451549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.451689] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.451776] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.451969] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.452083] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.452146] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.452297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.452375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.452573] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.452667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.452726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.452866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.452959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.453156] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.453251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.453322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.453474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.453550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.453636] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1302.519583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.519816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.519816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.520021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.520169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.530668] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1303.333642] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1303.334059] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 deletion is rescheduled due to dependency. [ 1303.334059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.259481] env[70032]: INFO networking_nsxv3.common.synchronization [req-bead206d-96b3-4c43-aff9-602f9554a2ce req-aae107f4-6777-4752-ad12-2b6f90afa78c tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1304.260064] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGHEST for action security_group_members [ 1304.260550] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.260643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.260748] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.260966] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.261146] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.261380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.261476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.261669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.261786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.261889] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.543440] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1304.543900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.764247] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.764413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.764462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.764682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.764774] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.764967] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.765087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.765150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.765298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.765378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.765465] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 is going to be updated. [ 1304.791016] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.791160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.791202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.791461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.791635] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.800231] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: IN_PROGRESS for 2s [ 1306.812535] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 in Status: SUCCESS [ 1306.812922] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 deletion is rescheduled due to dependency. [ 1306.812922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.591378] env[70032]: INFO networking_nsxv3.common.synchronization [req-f56cf28f-f7d9-475c-95dc-6769d0fb7690 req-b97d3603-0a67-4954-9cb4-27b441af2618 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1307.591884] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1307.592212] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.592334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.592404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.592595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.592743] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.592838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.592901] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.593181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.593287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.593385] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.095753] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.598043] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.001100] env[70032]: INFO networking_nsxv3.common.synchronization [None req-82f20280-f232-46ba-8b3e-d6ef44d158b9 tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1309.001594] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1309.001927] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.002029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.002100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.002354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.002438] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.064386] env[70032]: INFO networking_nsxv3.common.synchronization [None req-c4b4e342-000e-42f8-95ed-ec0d0ab0888f tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1309.064889] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1309.065181] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.065283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.100321] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.100637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.100637] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.100714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.100809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.100905] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1309.132021] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.132021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.132021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.132021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.132492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.142351] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1309.524708] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.524872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.524928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.525150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.525238] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.525334] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 already deleted. [ 1309.525418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.525563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.525714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.526264] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.047942] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.048126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.048173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.048369] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.048458] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.048558] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 already deleted. [ 1310.048638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.159025] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e2ef47d-f3ad-4e91-b1b5-315d52c5690e req-fdd7e5a1-4b7f-4051-a311-3ffd1700b88e tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1310.159025] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1310.159331] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.159424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.159520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.159675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.159822] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.159918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.159998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.160160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.160296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.160396] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.663232] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.663232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.663232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.663232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.663232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.663232] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.663232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.663232] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.663586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.663586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.663586] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be updated. [ 1310.696656] env[70032]: INFO networking_nsxv3.common.synchronization [req-76dc3af0-d1cc-479d-8d0a-62f9df1e02d4 req-bb8bade6-0ec9-4260-bf1e-d61c15c3c700 tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1310.697154] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1310.697446] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.697561] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.697623] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.697852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.697948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.698168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.698277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.698473] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.698605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.698734] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.724068] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.724227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.724299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.724494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.724634] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.733871] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: IN_PROGRESS for 2s [ 1311.023676] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.023916] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.024063] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.024385] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.024667] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.024827] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.024947] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.025188] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.025340] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.025545] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1311.025661] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1311.025773] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1311.025882] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1311.025995] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1311.026114] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1311.026248] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1311.044279] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1311.044433] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1311.044572] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1311.044758] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.045058] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-e51775c2-32fc-4274-9d21-d1a6f886a823 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.045227] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.045351] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.045642] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.045783] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51775c2-32fc-4274-9d21-d1a6f886a823',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.152395] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1311.152564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.202018] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.202362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.202362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.202440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.202510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.202716] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.202860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.202860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.203028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.203106] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.203194] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1311.237593] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.237763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.237809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.237972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.238122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.247277] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1311.547999] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.548183] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.548348] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.548642] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.548802] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.548964] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port e51775c2-32fc-4274-9d21-d1a6f886a823 not found, creating... [ 1311.549246] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.549408] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.549530] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.549756] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.549896] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.550198] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.550391] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.550516] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.550730] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.550869] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.551023] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: e51775c2-32fc-4274-9d21-d1a6f886a823 is going to be created. [ 1311.592052] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.592277] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.592410] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.592682] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.592915] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.593164] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.739110] env[70032]: INFO networking_nsxv3.common.synchronization [req-76dc3af0-d1cc-479d-8d0a-62f9df1e02d4 req-02bb1476-c9c1-40de-b037-55d21cebd34b service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 1312.739381] env[70032]: INFO networking_nsxv3.common.synchronization [req-76dc3af0-d1cc-479d-8d0a-62f9df1e02d4 req-02bb1476-c9c1-40de-b037-55d21cebd34b service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1312.739510] env[70032]: INFO networking_nsxv3.common.synchronization [req-76dc3af0-d1cc-479d-8d0a-62f9df1e02d4 req-02bb1476-c9c1-40de-b037-55d21cebd34b service nova] Enqueued Resource ID: e51775c2-32fc-4274-9d21-d1a6f886a823 with Priority: HIGHEST for action port [ 1312.740010] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 1312.740157] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1312.740246] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51775c2-32fc-4274-9d21-d1a6f886a823 with Priority: HIGHEST for action port [ 1312.740563] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.740686] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.740754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.740944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.741039] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.741882] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.742274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.742274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e51775c2-32fc-4274-9d21-d1a6f886a823 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.742417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.742417] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.742533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.742752] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51775c2-32fc-4274-9d21-d1a6f886a823',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.744118] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: SUCCESS [ 1312.744712] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 deletion is rescheduled due to dependency. [ 1312.744712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.244676] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.244923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.245173] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e51775c2-32fc-4274-9d21-d1a6f886a823 with status ACTIVE [ 1313.245351] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.245465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.245533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.245749] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.245840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.246023] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.246123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.246186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.246342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.246421] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.246603] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.246696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.246756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.246894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.246960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.247053] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e51775c2-32fc-4274-9d21-d1a6f886a823 is going to be updated. [ 1313.256149] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1313.256308] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 deletion is rescheduled due to dependency. [ 1313.256405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.256544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.256705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.256852] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.256951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.257025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.257172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.257250] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.257345] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.266826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.266941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.267009] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.267176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.267312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.267449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.759824] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.261627] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.764254] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.764760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.764760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.764760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.764935] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.764935] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1314.798575] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.798764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.798853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.798991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.799153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.808173] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1316.819183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1316.819503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.819503] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.819622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.819823] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.819931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.819996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.820158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.820239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.820342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.820453] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.322599] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.345999] env[70032]: INFO networking_nsxv3.common.synchronization [req-32fd9375-67ed-470f-b400-a12f832b4b18 req-22fc64d7-0c5c-4f1d-aafa-bcccdafa4b0e tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1317.347946] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1317.347946] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.347946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.347946] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.348716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.348886] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.348970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.349047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.349204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.349308] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.349377] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.680711] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.680909] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.681099] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.681453] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.681785] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.681996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.682178] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.682448] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.682666] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.682916] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1317.683084] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1317.683229] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1317.683369] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1317.683500] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1317.683616] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1317.683754] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1317.700515] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1317.700683] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1317.700820] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1317.700992] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.701390] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.701608] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.701736] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.702118] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.702264] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72084fe6-7bf0-405b-a43e-b1ce47b49e6e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.824878] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d6919e6-e32b-4e99-b10c-70b263dc0104: rpc.has_security_group_logging(os_id): False [ 1317.843131] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.843313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.843363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.843712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.843811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.844129] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.844268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.844358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.844551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.844655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.844768] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1317.852063] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.852264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.852264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.852508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.852611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.852854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.852960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.853034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.853195] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.853274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.853362] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 already deleted. [ 1317.853441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.902377] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.902629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.902629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.902827] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.902990] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.914716] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1318.204649] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.204847] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.204958] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.205266] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.205429] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.205590] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 72084fe6-7bf0-405b-a43e-b1ce47b49e6e not found, creating... [ 1318.205856] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.206029] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.206154] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.206384] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.206531] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.206849] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.207041] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.207169] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.207383] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.207526] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.207670] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e is going to be created. [ 1318.227540] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.227722] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.227838] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.228075] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.228296] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.228510] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.901289] env[70032]: INFO networking_nsxv3.common.synchronization [req-32fd9375-67ed-470f-b400-a12f832b4b18 req-77baea45-40e6-41cc-9523-dfafe0f3b713 service nova] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1318.901644] env[70032]: INFO networking_nsxv3.common.synchronization [req-32fd9375-67ed-470f-b400-a12f832b4b18 req-77baea45-40e6-41cc-9523-dfafe0f3b713 service nova] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1318.901644] env[70032]: INFO networking_nsxv3.common.synchronization [req-32fd9375-67ed-470f-b400-a12f832b4b18 req-77baea45-40e6-41cc-9523-dfafe0f3b713 service nova] Enqueued Resource ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e with Priority: HIGHEST for action port [ 1318.901913] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1318.902091] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1318.902091] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e with Priority: HIGHEST for action port [ 1318.902572] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.902691] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.902754] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.902951] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.903060] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.903816] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.903922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.903984] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.904171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.904350] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.904398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.904465] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.904590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.904738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.904837] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.905516] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.905641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.905641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.905751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.906071] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72084fe6-7bf0-405b-a43e-b1ce47b49e6e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.406851] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.407829] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.409082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.409082] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72084fe6-7bf0-405b-a43e-b1ce47b49e6e with status ACTIVE [ 1319.409082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.409082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.409082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.409082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.409082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.409468] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.409468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.409468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.409610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.409610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.410470] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.411032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.411032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.411032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.411032] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.411032] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e is going to be updated. [ 1319.431914] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.432153] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.432246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.432462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.432611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.432784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.604130] env[70032]: INFO networking_nsxv3.common.synchronization [None req-840b31de-d540-418f-895b-9e365ceab95a tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_rules [ 1319.604659] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_rules [ 1319.604970] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.605102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.605168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.605424] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.605506] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.679017] env[70032]: INFO networking_nsxv3.common.synchronization [None req-4263fdd4-0cbb-4c7b-af6f-70e96e39aba8 tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_rules [ 1319.679017] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_rules [ 1319.679570] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.679848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.913243] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.927591] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1319.927591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.127530] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.127705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.127778] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.127994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.128096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.128194] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d already deleted. [ 1320.128346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.128512] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.128669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.128750] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.416625] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.416836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.416942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.417186] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.417274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.417425] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 is going to be created. [ 1320.440501] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.440719] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.440772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.441026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.441175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.449963] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: UNINITIALIZED for 2s [ 1320.647504] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.647663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.647735] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.647952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.648056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.648187] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d already deleted. [ 1320.648241] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.570315] env[70032]: INFO networking_nsxv3.common.synchronization [req-3e6c6401-e08a-43db-9d69-2c757f01c5a1 req-caa326e9-a23e-4766-a51d-3e839345d907 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1321.570858] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1321.571179] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.571303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.571376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.571590] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.571748] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.571849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.571912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.573630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.573782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.573919] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.847267] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.847469] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.847660] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.847970] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.848246] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.848669] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.848669] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.848780] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.848923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.849124] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1321.849241] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1321.849353] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1321.849464] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1321.849577] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1321.849690] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1321.850254] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1321.868304] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1321.868493] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1321.868607] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1321.868785] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.869100] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-728b2dc5-6683-4f31-becb-cfe062fddf86 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.869277] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.869401] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.869713] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.869858] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('728b2dc5-6683-4f31-becb-cfe062fddf86',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.077418] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.320079] env[70032]: INFO networking_nsxv3.common.synchronization [None req-4664db4c-ab0b-41b9-adfc-8638cd33be37 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_rules [ 1322.321587] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_rules [ 1322.322124] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.322124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.322124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.322434] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.322434] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.372531] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.372996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.372996] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.373279] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.373431] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.373588] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 728b2dc5-6683-4f31-becb-cfe062fddf86 not found, creating... [ 1322.374556] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.374556] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.374556] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.374556] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.374556] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.374827] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.374909] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.375038] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.375256] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.375420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.375609] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 728b2dc5-6683-4f31-becb-cfe062fddf86 is going to be created. [ 1322.386642] env[70032]: INFO networking_nsxv3.common.synchronization [None req-f6852d1c-163b-4785-a7e8-4ee39f282618 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_rules [ 1322.386642] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_rules [ 1322.386642] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.386642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.394815] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.395015] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.395151] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.395403] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.395631] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.395856] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.460589] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: SUCCESS [ 1322.460780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.460941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.461167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.461364] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.461511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.461570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.461721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.461803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.461887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.461977] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.580171] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.840529] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.840703] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.840798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.841034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.841130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.841232] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 600953b9-3a24-4569-9195-e2009d66cbda already deleted. [ 1322.841317] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.841468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.841665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.841756] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.964327] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.082456] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.082650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.082709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.082914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.083011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.083125] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1323.111980] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.112383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.112383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.112514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.112557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.123289] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1323.217630] env[70032]: INFO networking_nsxv3.common.synchronization [req-3e6c6401-e08a-43db-9d69-2c757f01c5a1 req-df06341d-de1a-4412-84ed-8b509138974a service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1323.217747] env[70032]: INFO networking_nsxv3.common.synchronization [req-3e6c6401-e08a-43db-9d69-2c757f01c5a1 req-df06341d-de1a-4412-84ed-8b509138974a service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1323.217812] env[70032]: INFO networking_nsxv3.common.synchronization [req-3e6c6401-e08a-43db-9d69-2c757f01c5a1 req-df06341d-de1a-4412-84ed-8b509138974a service nova] Enqueued Resource ID: 728b2dc5-6683-4f31-becb-cfe062fddf86 with Priority: HIGHEST for action port [ 1323.218336] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1323.218469] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1323.218564] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b2dc5-6683-4f31-becb-cfe062fddf86 with Priority: HIGHEST for action port [ 1323.218844] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.218953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.219140] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.219273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.219356] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.220727] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.220828] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.221031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-728b2dc5-6683-4f31-becb-cfe062fddf86 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.221138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.221230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.221415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.221497] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('728b2dc5-6683-4f31-becb-cfe062fddf86',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.362875] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.363069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.363154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.363411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.363535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.363643] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 600953b9-3a24-4569-9195-e2009d66cbda already deleted. [ 1323.363745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.467109] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 089211d0-0678-4d8a-b45b-5e832cf3a642: rpc.has_security_group_logging(os_id): False [ 1323.484765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.484899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.484939] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.485174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.485264] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.485509] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.485627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.485692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.485839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.485907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.485991] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 is going to be created. [ 1323.544775] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.544945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.545011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.545205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.545384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.555079] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: IN_PROGRESS for 2s [ 1323.723025] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.723450] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.723450] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 728b2dc5-6683-4f31-becb-cfe062fddf86 with status ACTIVE [ 1323.723543] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.723649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.723714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.723929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.724034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.724219] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.724316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.724376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.724524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.724607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.724788] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.724880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.724941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.725098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.725177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.725260] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 728b2dc5-6683-4f31-becb-cfe062fddf86 is going to be updated. [ 1323.743716] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.743867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.743912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.744071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.744194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.744337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-728b2dc5-6683-4f31-becb-cfe062fddf86" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.134152] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1325.134449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.134525] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.134739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.134926] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.135060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.135123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.135282] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.135363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.135453] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.350665] env[70032]: INFO networking_nsxv3.common.synchronization [req-2eccc372-6e9b-4315-8767-57c8ffbe9bd6 req-14a571ca-3ddf-4da5-98b8-97cafe492bc9 tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_members [ 1325.351360] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_members [ 1325.351577] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.351766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.351872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.352547] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.352794] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.352923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.352991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.353172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.353263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.353358] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.566948] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: SUCCESS [ 1325.566948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.637610] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.690106] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.690454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.690688] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.691373] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.691864] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.692210] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.692489] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.692997] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.693209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.693599] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1325.694360] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1325.694360] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1325.694360] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1325.694644] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1325.694915] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1325.695245] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1325.714044] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1325.714323] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1325.714587] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1325.714867] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.715356] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-95481e04-8c15-422c-9796-0264433f48a3 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.715656] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.715905] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.716389] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.716646] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95481e04-8c15-422c-9796-0264433f48a3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.855196] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.855354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.855420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.855633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.855726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.855921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.856025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.856089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.856240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.856315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.856402] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d already deleted. [ 1325.856482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.140393] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.220479] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.220691] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.220826] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.221121] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.221282] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.221446] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 95481e04-8c15-422c-9796-0264433f48a3 not found, creating... [ 1326.221717] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.221872] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.221993] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.222238] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.222380] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.222663] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.222825] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.222945] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.223170] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.223312] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.223456] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 95481e04-8c15-422c-9796-0264433f48a3 is going to be created. [ 1326.243186] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.243430] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.243581] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.243823] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.244064] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.244292] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.642948] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.643130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.643206] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.643416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.643508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.643613] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1326.669033] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.669033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.669033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.669033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.669268] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.677481] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1327.191632] env[70032]: INFO networking_nsxv3.common.synchronization [req-2eccc372-6e9b-4315-8767-57c8ffbe9bd6 req-bc573f92-55ae-4fb1-b12b-6682275270d9 service nova] Enqueued Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_rules [ 1327.191958] env[70032]: INFO networking_nsxv3.common.synchronization [req-2eccc372-6e9b-4315-8767-57c8ffbe9bd6 req-bc573f92-55ae-4fb1-b12b-6682275270d9 service nova] Enqueued Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_members [ 1327.192127] env[70032]: INFO networking_nsxv3.common.synchronization [req-2eccc372-6e9b-4315-8767-57c8ffbe9bd6 req-bc573f92-55ae-4fb1-b12b-6682275270d9 service nova] Enqueued Resource ID: 95481e04-8c15-422c-9796-0264433f48a3 with Priority: HIGHEST for action port [ 1327.192350] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_rules [ 1327.192485] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_members [ 1327.192601] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95481e04-8c15-422c-9796-0264433f48a3 with Priority: HIGHEST for action port [ 1327.193199] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.193322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.193386] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.193584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.193668] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.194543] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.194659] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.194718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.194887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.195045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.195134] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.195224] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.195323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.195402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.195491] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.196590] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-95481e04-8c15-422c-9796-0264433f48a3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.196712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.196753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.196909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.196979] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95481e04-8c15-422c-9796-0264433f48a3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.698276] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.699319] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.699441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.702967] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95481e04-8c15-422c-9796-0264433f48a3 with status ACTIVE [ 1327.703174] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.703297] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.703365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.703566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.703661] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.703832] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.703929] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.703991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.704161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.704233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.704422] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.704516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.704580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.704709] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.704783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.704867] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95481e04-8c15-422c-9796-0264433f48a3 is going to be updated. [ 1327.723138] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.723270] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.723340] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.723534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.723630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.723780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95481e04-8c15-422c-9796-0264433f48a3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.998013] env[70032]: INFO networking_nsxv3.common.synchronization [req-9a882e18-c575-45c9-81b7-bc65ee1ec40f req-3ce88725-dd3c-4210-8bf7-e65e7b930c1c tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_members [ 1327.999039] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_members [ 1327.999039] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.999039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.999039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.999322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.999359] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.999463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.999545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.999682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.999770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.999863] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.201899] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.262892] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.263179] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.263245] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.263505] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.263775] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.263937] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.264071] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.264295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.264460] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.264679] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1328.264799] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1328.264913] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1328.265037] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1328.265172] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1328.265318] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1328.265504] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1328.283812] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1328.283987] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1328.284099] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1328.284259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.284598] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a5222ba8-25de-4212-81d7-8a54cdb920b4 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.284777] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.285010] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.285246] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.285406] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5222ba8-25de-4212-81d7-8a54cdb920b4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.502057] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.502057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.502392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.502459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.502550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.502837] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.502979] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.503067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.503271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.503376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.503496] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 600953b9-3a24-4569-9195-e2009d66cbda already deleted. [ 1328.503611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.686642] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1328.686642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.686806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.687036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.687238] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.687355] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.687419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.687573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.687655] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.687742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.687831] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.703250] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.703409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.703468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.703665] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.703743] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.703847] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d is going to be created. [ 1328.727180] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.727402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.727402] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.727595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.728249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.737241] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d in Status: UNINITIALIZED for 2s [ 1328.789032] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.789032] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.789259] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.789641] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.789881] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.790132] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a5222ba8-25de-4212-81d7-8a54cdb920b4 not found, creating... [ 1328.790555] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.790797] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.790984] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.791327] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.791547] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.791991] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.792246] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.792453] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.792728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.792940] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.793163] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a5222ba8-25de-4212-81d7-8a54cdb920b4 is going to be created. [ 1328.813067] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.813338] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.813528] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.813861] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.814198] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.814506] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.190047] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.190047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.190252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.190291] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.190612] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.190757] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.190801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.190977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.191108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.191229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.191419] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.191589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.191658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.191842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.192030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.192160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.192244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.192413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.192515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.192610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.192705] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.524013] env[70032]: INFO networking_nsxv3.common.synchronization [req-9a882e18-c575-45c9-81b7-bc65ee1ec40f req-69f12354-e827-450b-bbeb-d5f91ef95ebe service nova] Enqueued Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_rules [ 1329.524355] env[70032]: INFO networking_nsxv3.common.synchronization [req-9a882e18-c575-45c9-81b7-bc65ee1ec40f req-69f12354-e827-450b-bbeb-d5f91ef95ebe service nova] Enqueued Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_members [ 1329.524613] env[70032]: INFO networking_nsxv3.common.synchronization [req-9a882e18-c575-45c9-81b7-bc65ee1ec40f req-69f12354-e827-450b-bbeb-d5f91ef95ebe service nova] Enqueued Resource ID: a5222ba8-25de-4212-81d7-8a54cdb920b4 with Priority: HIGHEST for action port [ 1329.525351] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_rules [ 1329.525560] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_members [ 1329.525724] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5222ba8-25de-4212-81d7-8a54cdb920b4 with Priority: HIGHEST for action port [ 1329.526139] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.526330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.526478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.526746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.526882] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.528083] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.528269] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.528384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.528601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.528757] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.528907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.528907] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.529088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.529221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.529347] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.530737] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5222ba8-25de-4212-81d7-8a54cdb920b4 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.530834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.530941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.531218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.531356] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5222ba8-25de-4212-81d7-8a54cdb920b4',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.694672] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3009f70d-c184-49eb-851b-1a0b6b0a658c: rpc.has_security_group_logging(os_id): False [ 1329.713205] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.713411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.713411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.713603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.713697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.713885] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.713985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.714062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.714216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.714294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.714491] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.714588] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.714649] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.714788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.714877] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.715082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.715170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.715205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.715320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.715392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.715477] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1329.771031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.771031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.771031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.771031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.771031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.783768] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1330.032888] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.033938] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.034065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.035553] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5222ba8-25de-4212-81d7-8a54cdb920b4 with status ACTIVE [ 1330.035729] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.035871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.035920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.036111] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.036204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.036374] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.036493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.036532] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.036673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.036752] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.036926] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.037028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.037089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.037227] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.037303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.037386] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5222ba8-25de-4212-81d7-8a54cdb920b4 is going to be updated. [ 1330.055830] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.055985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.056040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.056203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.056327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.056481] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5222ba8-25de-4212-81d7-8a54cdb920b4" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.535163] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.747890] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d in Status: SUCCESS [ 1330.748136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.748293] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.748509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.748693] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.748807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.748871] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.749031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.749115] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.749202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.749294] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.037271] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.037271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.037514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.037514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.037666] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.037736] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 600953b9-3a24-4569-9195-e2009d66cbda is going to be created. [ 1331.063017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.063100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.063165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.063365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.063524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.072997] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 600953b9-3a24-4569-9195-e2009d66cbda in Status: UNINITIALIZED for 2s [ 1331.252058] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.754097] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0492d1cb-b735-4632-8c66-1d2fadd7ef6d: rpc.has_security_group_logging(os_id): False [ 1331.772728] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.772873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.772945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.773165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.773255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.773496] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.773598] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.773660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.773807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.773880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.773969] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d is going to be created. [ 1331.820592] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1331.820861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.929981] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.930150] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.930221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.930429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.930642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.940288] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d in Status: IN_PROGRESS for 2s [ 1333.082741] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 600953b9-3a24-4569-9195-e2009d66cbda in Status: SUCCESS [ 1333.083207] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.083323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.083509] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.083706] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.083867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.083934] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.084110] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.084196] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.084276] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.084390] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.587218] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.952637] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d in Status: SUCCESS [ 1333.952942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.089841] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 600953b9-3a24-4569-9195-e2009d66cbda: rpc.has_security_group_logging(os_id): False [ 1334.107133] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.107133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.107133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.107133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.107133] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.107397] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.107397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.107397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.107515] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.107551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.107641] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 600953b9-3a24-4569-9195-e2009d66cbda is going to be created. [ 1334.160947] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.161198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.161198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.161371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.161647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.173656] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 600953b9-3a24-4569-9195-e2009d66cbda in Status: IN_PROGRESS for 2s [ 1334.526786] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.526986] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1336.186669] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 600953b9-3a24-4569-9195-e2009d66cbda in Status: SUCCESS [ 1336.186669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.230110] env[70032]: INFO networking_nsxv3.common.synchronization [req-eea74503-2143-4050-be49-b53831343548 req-e3bd0e6f-583b-4542-b7cb-e67635523e24 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1336.230110] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1336.230453] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.230732] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.230811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.231040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.231244] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.231431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.231591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.231814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.232016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.232159] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.506755] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.506944] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.507101] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.508017] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.508017] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.508017] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.508017] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.509061] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.509061] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.509061] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1336.509061] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1336.509061] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1336.509061] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1336.509061] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1336.509302] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1336.509302] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1336.531026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1336.531026] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1336.534665] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1336.534665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.534665] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.534665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.534665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.534665] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.534665] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9efff44-5cac-46c5-bbe1-2f8e0e310d9c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.734387] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.041583] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.041865] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.042162] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.042576] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.042908] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.043243] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port f9efff44-5cac-46c5-bbe1-2f8e0e310d9c not found, creating... [ 1337.043736] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.044007] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.044190] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.044485] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.044683] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.045069] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.045344] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.045579] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.045908] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.046129] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.046366] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: f9efff44-5cac-46c5-bbe1-2f8e0e310d9c is going to be created. [ 1337.066214] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.066529] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.066782] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.067065] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.067335] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.067583] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.237873] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.741060] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.741243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.741352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.741609] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.742125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.742293] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1337.770989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.779223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.779223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.779223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.779223] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.783865] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1337.818122] env[70032]: INFO networking_nsxv3.common.synchronization [req-eea74503-2143-4050-be49-b53831343548 req-5426779e-8d54-49b5-9513-b021d912b85c service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1337.818638] env[70032]: INFO networking_nsxv3.common.synchronization [req-eea74503-2143-4050-be49-b53831343548 req-5426779e-8d54-49b5-9513-b021d912b85c service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1337.821973] env[70032]: INFO networking_nsxv3.common.synchronization [req-eea74503-2143-4050-be49-b53831343548 req-5426779e-8d54-49b5-9513-b021d912b85c service nova] Enqueued Resource ID: f9efff44-5cac-46c5-bbe1-2f8e0e310d9c with Priority: HIGHEST for action port [ 1337.822580] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1337.823490] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1337.823675] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9efff44-5cac-46c5-bbe1-2f8e0e310d9c with Priority: HIGHEST for action port [ 1337.824028] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.824209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.824321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.824570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.824714] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.829020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.829020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.829020] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.829020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.829020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.829020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.829020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9efff44-5cac-46c5-bbe1-2f8e0e310d9c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.006823] env[70032]: INFO networking_nsxv3.common.synchronization [req-a4692baa-3380-435e-b535-b0deaaee4f18 req-cdcf66be-dd12-4a53-926c-a3ebca894d60 tempest-AttachVolumeTestJSON-1642023009 tempest-AttachVolumeTestJSON-1642023009-project-member] Enqueued Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_members [ 1338.007377] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGHEST for action security_group_members [ 1338.007704] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.007830] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.007896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.009087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.009087] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.009243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.009243] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.009416] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.009499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.009588] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.328163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.328562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.330854] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9efff44-5cac-46c5-bbe1-2f8e0e310d9c with status ACTIVE [ 1338.331157] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.331338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.331418] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.331653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.331759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.331986] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.332116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.332185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.332379] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.332460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.332655] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.332766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.332835] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.333021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.333925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.333925] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9efff44-5cac-46c5-bbe1-2f8e0e310d9c is going to be updated. [ 1338.355069] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.355309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.355364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.355713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.355870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.356125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9efff44-5cac-46c5-bbe1-2f8e0e310d9c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.513235] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.513456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.513456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.513650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.513760] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.514470] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.514470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.514470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.514470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.514470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.514772] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa is going to be updated. [ 1338.543207] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.543428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.543428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.543615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.543758] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.554690] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bc461d7-4f61-4222-8718-50d24f7845aa in Status: IN_PROGRESS for 2s [ 1339.794255] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1339.794452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.794566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.794783] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.794995] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.795096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.795164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.795312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.795395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.795491] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.297983] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.563686] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bc461d7-4f61-4222-8718-50d24f7845aa in Status: SUCCESS [ 1340.563866] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa deletion is rescheduled due to dependency. [ 1340.563981] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.800912] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.303874] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.304116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.304116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.304342] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.304439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.304543] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1341.330289] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.330492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.330538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.330807] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.330971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.338775] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1343.008462] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.008462] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1343.350214] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1343.350444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.350591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.351044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.351260] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.351388] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.351460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.351628] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.351751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.351858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.351955] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.853963] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.854183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.854183] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.854477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.854737] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.854910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.855025] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.855267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.855404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.855530] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.855688] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.855789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.855859] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.855988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.856136] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.856229] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.856287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.856420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.856497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.856578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.856665] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.359051] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3009f70d-c184-49eb-851b-1a0b6b0a658c: rpc.has_security_group_logging(os_id): False [ 1344.375899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.376124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.376219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.376475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.376587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.376778] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.376878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.376943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.377126] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.377205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.377430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.377567] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.377632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.377797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.377875] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.378079] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.378182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.378244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.378398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.378482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.378583] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1344.437955] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.438124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.438215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.438443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.438584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.451338] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1346.466920] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1346.467315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.009699] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.009935] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.716863] env[70032]: INFO networking_nsxv3.common.synchronization [req-79789688-8cfc-41df-aa2a-f010c5c3e091 req-61072b86-fe3f-4787-bdee-700e5a6708d9 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1348.717423] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1348.717752] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.717886] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.717957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.718189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.718350] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.718451] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.718523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.718698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.718801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.718909] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.221316] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.724040] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.226075] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.226429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.226429] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.226501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.226596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.226692] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1350.258158] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.258330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.258373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.258568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.258727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.267175] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1352.276924] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1352.277444] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.600090] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1352.600340] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1353.718418] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.718418] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.262701] env[70032]: INFO networking_nsxv3.common.synchronization [req-1b0b5684-1166-489b-9c20-b0199ffc1388 req-51e6f1fe-14c3-4a2d-99c7-840f721fe599 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1355.263262] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1355.263899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.264714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.264714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.264714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.264714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.264714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.264714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.264714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.265104] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.265104] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.729409] env[70032]: INFO networking_nsxv3.common.synchronization [req-6e5db6c2-a88d-48cb-aaec-a16b6726c1b8 req-44e41071-7c9d-4567-836c-455b38c5c111 tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_members [ 1355.729952] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGHEST for action security_group_members [ 1355.730274] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.730480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.730551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.730761] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.730930] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.731046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.731114] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.731271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.731358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.731449] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.766207] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.234475] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.234675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.234852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.235037] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.235176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.235404] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.235510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.235615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.235817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.235944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.236099] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 is going to be updated. [ 1356.265812] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.266100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.266100] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.266185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.266281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.267629] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.273632] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 in Status: IN_PROGRESS for 2s [ 1356.770074] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.770246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.770322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.770535] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.770627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.770729] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1356.799999] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.800658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.800658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.800658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.800658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.810524] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1358.283617] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 in Status: SUCCESS [ 1358.283996] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 deletion is rescheduled due to dependency. [ 1358.283996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.818866] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1358.819046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.731290] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.731549] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.732273] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.732581] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.937408] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e95c398-30ab-443b-b926-573c0b3eb238 req-41eaec42-e102-4f3a-a308-0edbd043c4ad tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1365.937752] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1365.938081] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.938209] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.938290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.938504] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.938658] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.938806] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.938925] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.939277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.939377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.939474] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.233332] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.233549] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.233678] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.234071] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.234641] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.234641] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.234799] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.234973] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.235150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.235397] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.235587] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.236019] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.236019] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.236019] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.236200] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.236290] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.257019] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.257238] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1366.257389] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.257567] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.257894] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.258146] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.258205] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.258565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.258711] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.441881] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.761243] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.761576] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.761619] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.761888] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.762059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.762219] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 not found, creating... [ 1366.762483] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.762642] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.762760] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.762992] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.763180] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.763513] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.763624] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.763735] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.763941] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.764102] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.764243] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 is going to be created. [ 1366.783823] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.784044] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.784167] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.784421] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.784645] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.784864] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.944779] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.447374] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.447643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.447731] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.447953] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.448063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.448164] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1367.474291] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.474678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.474678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.474945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.476419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.479119] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e95c398-30ab-443b-b926-573c0b3eb238 req-3cd48bfc-ce51-49ac-9669-8105b902c3bb service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1367.479365] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e95c398-30ab-443b-b926-573c0b3eb238 req-3cd48bfc-ce51-49ac-9669-8105b902c3bb service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1367.479576] env[70032]: INFO networking_nsxv3.common.synchronization [req-2e95c398-30ab-443b-b926-573c0b3eb238 req-3cd48bfc-ce51-49ac-9669-8105b902c3bb service nova] Enqueued Resource ID: a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 with Priority: HIGHEST for action port [ 1367.480408] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1367.480593] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1367.480745] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 with Priority: HIGHEST for action port [ 1367.481200] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.481358] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.481462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.481965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.482147] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.483099] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.483251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.483493] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.483645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.483802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.484059] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.484185] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.486724] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1367.986100] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.986734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.986734] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 with status ACTIVE [ 1367.986734] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.986734] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.986997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.986997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.987127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.987454] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.987454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.987454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.987848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.987848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.987848] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.988162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.988162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.988162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.988162] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.988378] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82 is going to be updated. [ 1368.016031] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.016031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.016031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.016031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.016031] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.016383] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8a0e0ee-5bcc-40c7-a076-2f6aba0f2c82" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.496029] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1369.496396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.496396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.496549] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.496800] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.496926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.496991] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.497239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.497328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.497422] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.000943] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.502662] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.005323] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.005513] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.005560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.005763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.005858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.005962] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1371.040264] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.040459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.040459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.040676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.040814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.050050] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1372.482183] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.482703] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1373.060309] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1373.060520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.060681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.060904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.061143] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.061272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.061322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.061476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.061555] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.061639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.061734] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.564840] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.564840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.564840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.564840] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.565397] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.565397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.565397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.565562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.565610] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.565716] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.565898] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.566119] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.566273] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.566480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.566674] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.566788] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.566900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.567067] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.567182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.567277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.567378] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.069882] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3009f70d-c184-49eb-851b-1a0b6b0a658c: rpc.has_security_group_logging(os_id): False [ 1374.094280] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.094498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.094498] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.094688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.094779] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.094983] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.095198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.095295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.095520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.095615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.095826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.095922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.095985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.096145] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.096220] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.096406] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.096518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.096558] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.096681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.096755] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.096838] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1374.161396] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.161606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.161606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.161721] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.161880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.178126] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1376.194794] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1376.195169] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.483753] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.484098] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.097826] env[70032]: INFO networking_nsxv3.common.synchronization [req-5f9fd376-7f6f-4fed-9f01-a2fde0a5e9ac req-9aca9ccd-1d52-4d7c-96ca-1a353d402177 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1379.098376] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1379.098664] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.098790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.098856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.099274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.099447] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.099551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.099617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.099784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.099857] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.099952] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.549920] env[70032]: INFO networking_nsxv3.common.synchronization [req-012bbd17-5358-4783-8919-eb85cf13fbe9 req-bbf955c1-b7cc-4357-ac6c-dabdec71195b tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_members [ 1379.549920] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGHEST for action security_group_members [ 1379.549920] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.550216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.550216] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.550319] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.550490] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.550593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.550669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.550825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.550917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.551021] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.602459] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.053558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.053729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.053825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.054159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.054316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.054554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.054688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.054771] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.054963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.055087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.055201] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 600953b9-3a24-4569-9195-e2009d66cbda is going to be updated. [ 1380.082738] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.083161] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.083280] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.083522] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.083667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.092555] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 600953b9-3a24-4569-9195-e2009d66cbda in Status: IN_PROGRESS for 2s [ 1380.104971] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.607945] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.608198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.608198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.608420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.608516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.608615] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1380.637589] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.637838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.637838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.638121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.638277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.648484] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1382.101720] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 600953b9-3a24-4569-9195-e2009d66cbda in Status: IN_PROGRESS for 4s [ 1382.534804] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.534894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.534936] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.535189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.535305] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.658192] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1382.659093] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.039760] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.541907] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.044063] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1384.044185] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1384.117240] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 600953b9-3a24-4569-9195-e2009d66cbda in Status: SUCCESS [ 1384.117433] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 600953b9-3a24-4569-9195-e2009d66cbda deletion is rescheduled due to dependency. [ 1384.117551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.550276] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.550276] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.880615] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.880767] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.880839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.881073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.895332] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1384.896323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.897431] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1384.935670] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.935818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.935818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.937054] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.950471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.951300] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1384.951411] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1384.951465] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1384.993039] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.993185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.993286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.993494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.994650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.994826] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1385.072022] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.072022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.072022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.072022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.072022] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.072022] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1385.170373] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.170543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.170543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.170759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.171101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.171452] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1385.171551] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7e992527-e74e-4251-a2db-cbb2515a8605', 'cd262fda-5bb7-40bc-b4f2-b2cdd0080c60', 'a593b272-d3dd-4035-9c2e-1bb9cca70df6', 'b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e', 'a7b2bda6-e2c6-4891-b6fc-b19e87eed978', '26d43c7c-82c8-4a83-8478-40e297491039', 'b1c12e03-bdb4-4d99-81b1-a03d701f2dfc', '3f5dd232-e552-483f-8e40-b495ebe5e511', '531ad586-f734-4279-9db3-fc308558885e', '1f0e8ca4-9613-4991-a992-cf2ef6089b55', 'e2e38683-4e39-4757-9135-1e4fb3be9d1c', '600953b9-3a24-4569-9195-e2009d66cbda', '1ac44685-7555-444d-b1ce-19ece671a825', '61533d93-47dd-40b4-b191-9d366077f93c', 'd880077d-b1e8-47fa-bc09-7da9308456b0', '089211d0-0678-4d8a-b45b-5e832cf3a642', '1e94337d-b9be-48c8-8c35-01c45e2baf7c', '1110e864-8fe2-4147-ac63-04a6f0d7e278', '4bc461d7-4f61-4222-8718-50d24f7845aa', 'c26164ff-f3d0-4ac4-97ed-86984dd723e3', 'a60e0c43-f06a-467e-816b-4e256badc10b', '00b9cad3-7556-42c3-8caf-441973387e39', 'd451476b-b529-46a5-ac42-f7b74140c983', '0d217ae0-b74a-4bed-9ca6-45df455c7a58', '4e2dd745-ad31-4195-9f0e-c534fa480580', '5000c8de-0235-4e38-93be-83111bb42b93', 'ec6619bd-9b1f-429e-957b-14f3db7e57f0', '57f7eded-33f5-4584-a001-a880d502f14f', '8d6919e6-e32b-4e99-b10c-70b263dc0104', '449f8b7d-089e-4037-adbd-8e1125cab8b6', '3f8ad78a-3466-4ff5-8d70-3fec6284010d', 'f3034974-c557-4de5-9753-a08e1f169c15', 'f5730a18-9b02-4aad-abe1-e7789de465fd', '00371e37-ee75-4ff4-9639-24f7314003da', 'bb0f9ea3-e335-4804-8789-09a66f5ffeef', 'c54f2196-33e3-453f-a911-75188cea4a01', '8ab8694e-7329-47c5-b4fe-30318bb49368', '3009f70d-c184-49eb-851b-1a0b6b0a658c', 'bccc08ea-f041-453a-b54a-615933f6cecf', '42d4b17b-1bab-41c3-94ca-ac72b8e35f54', '0492d1cb-b735-4632-8c66-1d2fadd7ef6d', '9aeb2bb4-b636-44df-88aa-d607d160cac8', '27ec5bcd-a30c-4400-8500-5f69d46c0d4f', 'b20098c3-4944-4612-af2a-f2d01874388d'} {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1385.171662] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1385.194708] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.194829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.194995] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.195124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.195239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.195294] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1385.195337] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1385.195408] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1385.267761] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.267938] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.268026] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.268267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.269545] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.269855] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1385.269938] env[70032]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70032) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1385.270021] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1385.270082] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1385.270164] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1385.270252] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGH for action security_group_rules [ 1385.270323] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGH for action security_group_rules [ 1385.270392] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGH for action security_group_rules [ 1385.270467] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGH for action security_group_rules [ 1385.270539] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGH for action security_group_rules [ 1385.270599] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGH for action security_group_rules [ 1385.270705] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGH for action security_group_rules [ 1385.270859] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGH for action security_group_rules [ 1385.270859] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGH for action security_group_rules [ 1385.271168] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGH for action security_group_rules [ 1385.271168] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGH for action security_group_rules [ 1385.271168] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGH for action security_group_rules [ 1385.271355] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGH for action security_group_rules [ 1385.271447] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGH for action security_group_rules [ 1385.271538] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGH for action security_group_rules [ 1385.271621] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGH for action security_group_rules [ 1385.271706] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGH for action security_group_rules [ 1385.271783] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGH for action security_group_rules [ 1385.271862] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGH for action security_group_rules [ 1385.271944] env[70032]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGH for action security_group_rules [ 1385.273155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.829270] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.829677] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.829677] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.829836] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.830118] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.830282] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.830454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.830633] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.830796] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.831034] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.831754] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1388.831902] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1388.832041] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1388.832199] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.832345] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1388.832490] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1388.851988] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1388.852194] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1388.852330] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1388.852534] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-294" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.852830] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-e51775c2-32fc-4274-9d21-d1a6f886a823 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.852998] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.853134] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.853377] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.853597] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51775c2-32fc-4274-9d21-d1a6f886a823',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.355977] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.356201] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.356305] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.356651] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.356816] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.357118] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.357281] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.357402] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.357625] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.357764] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.358056] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.358215] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.358336] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.358559] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.358691] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.358836] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: e51775c2-32fc-4274-9d21-d1a6f886a823 is going to be updated. [ 1389.377569] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.377748] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.377858] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.378086] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.378269] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.378469] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.550802] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.550939] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1389.551065] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGH for action security_group_rules [ 1389.551211] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 with Priority: HIGH for action security_group_rules [ 1389.551314] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc with Priority: HIGH for action security_group_rules [ 1389.551414] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d880077d-b1e8-47fa-bc09-7da9308456b0 with Priority: HIGH for action security_group_rules [ 1389.551510] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 with Priority: HIGH for action security_group_rules [ 1389.551603] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc461d7-4f61-4222-8718-50d24f7845aa with Priority: HIGH for action security_group_rules [ 1389.551695] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGH for action security_group_rules [ 1389.552167] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c with Priority: HIGH for action security_group_rules [ 1389.552351] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61533d93-47dd-40b4-b191-9d366077f93c with Priority: HIGH for action security_group_rules [ 1389.552452] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGH for action security_group_rules [ 1389.552548] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac44685-7555-444d-b1ce-19ece671a825 with Priority: HIGH for action security_group_rules [ 1389.552641] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 600953b9-3a24-4569-9195-e2009d66cbda with Priority: HIGH for action security_group_rules [ 1389.552731] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c with Priority: HIGH for action security_group_rules [ 1389.552819] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 with Priority: HIGH for action security_group_rules [ 1389.552909] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531ad586-f734-4279-9db3-fc308558885e with Priority: HIGH for action security_group_rules [ 1389.552997] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d43c7c-82c8-4a83-8478-40e297491039 with Priority: HIGH for action security_group_rules [ 1389.553199] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGH for action security_group_rules [ 1389.553199] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 with Priority: HIGH for action security_group_rules [ 1389.553305] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 with Priority: HIGH for action security_group_rules [ 1389.553389] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e with Priority: HIGH for action security_group_rules [ 1389.553721] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.553851] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.553918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.554275] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.554365] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.555765] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.555992] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.556102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.556299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.556381] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a593b272-d3dd-4035-9c2e-1bb9cca70df6',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.557480] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.558236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.558236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.558236] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.558236] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c12e03-bdb4-4d99-81b1-a03d701f2dfc',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.560052] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d880077d-b1e8-47fa-bc09-7da9308456b0 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.560052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.560052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.560052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.560052] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d880077d-b1e8-47fa-bc09-7da9308456b0',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.560629] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.560784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.560852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.560967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.561094] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c26164ff-f3d0-4ac4-97ed-86984dd723e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.562159] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bc461d7-4f61-4222-8718-50d24f7845aa taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.562290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.562334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.562467] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.562535] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bc461d7-4f61-4222-8718-50d24f7845aa',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.563220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.563335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.563409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.563550] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.563611] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.564287] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.564410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.564475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.564662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.564742] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e94337d-b9be-48c8-8c35-01c45e2baf7c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.566544] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61533d93-47dd-40b4-b191-9d366077f93c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.566704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.566740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.566866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.566940] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61533d93-47dd-40b4-b191-9d366077f93c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.567711] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.567812] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.567868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.568029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.568103] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.568732] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac44685-7555-444d-b1ce-19ece671a825 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.568839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.569036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.569121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.569162] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac44685-7555-444d-b1ce-19ece671a825',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.569835] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-600953b9-3a24-4569-9195-e2009d66cbda taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.569944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.569996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.570138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.570204] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('600953b9-3a24-4569-9195-e2009d66cbda',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.570973] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.570973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.571138] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.571191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.571263] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2e38683-4e39-4757-9135-1e4fb3be9d1c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.572109] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.572109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.572212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.572331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.572384] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f0e8ca4-9613-4991-a992-cf2ef6089b55',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.573059] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531ad586-f734-4279-9db3-fc308558885e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.573174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.573174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.573373] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.573495] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531ad586-f734-4279-9db3-fc308558885e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.574037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26d43c7c-82c8-4a83-8478-40e297491039 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.574147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.574208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.574359] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.574430] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26d43c7c-82c8-4a83-8478-40e297491039',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.575191] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.575299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.575366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.575510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.575581] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.576261] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.576366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.576432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.576576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.576648] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7b2bda6-e2c6-4891-b6fc-b19e87eed978',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.577300] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.577406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.577471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.577618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.577689] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd262fda-5bb7-40bc-b4f2-b2cdd0080c60',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.578348] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.578443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.578508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.578652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.578724] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.056307] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.056580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.056627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.056816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.056989] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.057101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.057248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.057299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.057440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.057506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.057552] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.077296] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.077460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.077604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.077765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.079640] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.079733] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.085922] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.086045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.086125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.086304] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.086467] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.090020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.090020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.090020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.090020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.090020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.090020] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.098508] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.098626] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c12e03-bdb4-4d99-81b1-a03d701f2dfc is going to be deleted. [ 1390.101329] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.101462] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.101528] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.101671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.106662] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.106781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.110579] env[70032]: INFO networking_nsxv3.common.synchronization [req-012da95e-8fbe-4ed3-afae-e5b220723323 req-839c704e-add2-45c5-a7eb-1138e634fa7b service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 1390.110750] env[70032]: INFO networking_nsxv3.common.synchronization [req-012da95e-8fbe-4ed3-afae-e5b220723323 req-839c704e-add2-45c5-a7eb-1138e634fa7b service nova] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1390.110903] env[70032]: INFO networking_nsxv3.common.synchronization [req-012da95e-8fbe-4ed3-afae-e5b220723323 req-839c704e-add2-45c5-a7eb-1138e634fa7b service nova] Enqueued Resource ID: e51775c2-32fc-4274-9d21-d1a6f886a823 with Priority: HIGHEST for action port [ 1390.115914] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_rules [ 1390.115914] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1390.115914] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51775c2-32fc-4274-9d21-d1a6f886a823 with Priority: HIGHEST for action port [ 1390.128921] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.129058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.129137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.129337] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.129424] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.130331] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.130447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.130520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.130651] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.130792] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.130896] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.130964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.131130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.131242] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.131341] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.132112] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e51775c2-32fc-4274-9d21-d1a6f886a823 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.132284] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.132328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.132475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.132554] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51775c2-32fc-4274-9d21-d1a6f886a823',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.136027] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.136139] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.144933] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.144933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.150174] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.150300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.151495] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.151495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.152082] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.152172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.152894] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.152986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.153899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.153997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.154698] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.154805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.155499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.155616] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e94337d-b9be-48c8-8c35-01c45e2baf7c is going to be deleted. [ 1390.156492] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.156726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.158160] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.158218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.158862] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.158971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.159625] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1390.159999] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.160121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.160759] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1390.161194] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.161305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.162607] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1390.162993] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.163099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.163982] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1390.164326] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.164441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.177105] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1390.177531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.177645] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c26164ff-f3d0-4ac4-97ed-86984dd723e3 is going to be deleted. [ 1390.178459] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.178662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.206768] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.206909] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a593b272-d3dd-4035-9c2e-1bb9cca70df6 is going to be deleted. [ 1390.207861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.208079] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.209443] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.209573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.231259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.231375] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 600953b9-3a24-4569-9195-e2009d66cbda is going to be deleted. [ 1390.232132] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.232344] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.239344] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.239479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.259240] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.259392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.264640] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.264763] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.282906] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1390.283332] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.283478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.288551] env[70032]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1390.289012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.289143] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd262fda-5bb7-40bc-b4f2-b2cdd0080c60 is going to be deleted. [ 1390.290012] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.290230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.382833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.383037] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7b2bda6-e2c6-4891-b6fc-b19e87eed978 is going to be deleted. [ 1390.383928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.384249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.417943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.418066] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f0e8ca4-9613-4991-a992-cf2ef6089b55 is going to be deleted. [ 1390.418843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.419051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.465707] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.465817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.474168] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.474307] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26d43c7c-82c8-4a83-8478-40e297491039 is going to be deleted. [ 1390.475125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.475331] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.538573] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.538698] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.541604] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.541714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.550463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.550595] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be deleted. [ 1390.551592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.552212] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.560598] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.587293] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.587579] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.588670] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.588825] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 is going to be deleted. [ 1390.589729] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.589945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.599100] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.641034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.641034] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531ad586-f734-4279-9db3-fc308558885e is going to be deleted. [ 1390.641879] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e51775c2-32fc-4274-9d21-d1a6f886a823 with status ACTIVE [ 1390.642098] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.642226] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.642289] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.642475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.642560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.642725] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.642820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.642883] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.643041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.643121] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.643306] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.643448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.643544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.643998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.643998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.643998] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e51775c2-32fc-4274-9d21-d1a6f886a823 is going to be updated. [ 1390.644726] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.644818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.644972] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.645688] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.645852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.680495] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.680495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.680495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.680495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.680894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.680894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e51775c2-32fc-4274-9d21-d1a6f886a823" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.693409] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.694322] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2e38683-4e39-4757-9135-1e4fb3be9d1c is going to be deleted. [ 1390.695160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.695160] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.697797] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.698576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.714957] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.714957] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.765675] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.765825] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bc461d7-4f61-4222-8718-50d24f7845aa is going to be deleted. [ 1390.766741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.766963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.770258] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.770382] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.805980] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.806154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.818707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.818828] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e is going to be deleted. [ 1390.819705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.819921] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.867911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.868041] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac44685-7555-444d-b1ce-19ece671a825 is going to be deleted. [ 1390.868850] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.869071] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.930142] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.930327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.938405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.938542] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61533d93-47dd-40b4-b191-9d366077f93c is going to be deleted. [ 1390.939398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.939594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.942356] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.942448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.987542] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.987677] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.009011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.009233] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d880077d-b1e8-47fa-bc09-7da9308456b0 is going to be deleted. [ 1391.010087] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.010295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.010392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.010517] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c12e03-bdb4-4d99-81b1-a03d701f2dfc" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.010668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.010832] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.010913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.011036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e94337d-b9be-48c8-8c35-01c45e2baf7c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.011566] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.011753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.011838] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.011965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a593b272-d3dd-4035-9c2e-1bb9cca70df6" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.012605] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.012699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.012766] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.012913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.012993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.013118] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61533d93-47dd-40b4-b191-9d366077f93c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.013235] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.013378] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.013479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.013564] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c26164ff-f3d0-4ac4-97ed-86984dd723e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.013674] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.013808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.013879] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.013987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-600953b9-3a24-4569-9195-e2009d66cbda" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.014123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.014261] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.014336] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.014447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd262fda-5bb7-40bc-b4f2-b2cdd0080c60" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.014552] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.014685] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.014759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.014867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7b2bda6-e2c6-4891-b6fc-b19e87eed978" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.014989] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.015144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.015219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.015351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f0e8ca4-9613-4991-a992-cf2ef6089b55" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.015463] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.015604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.015676] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.015782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26d43c7c-82c8-4a83-8478-40e297491039" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.015904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.016053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.016128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.016233] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.016341] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.016475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.016548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.016653] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.016777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.016911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.016982] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.017097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531ad586-f734-4279-9db3-fc308558885e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.017203] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.017338] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.017408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.017507] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2e38683-4e39-4757-9135-1e4fb3be9d1c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.017629] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.017762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.017834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.017940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bc461d7-4f61-4222-8718-50d24f7845aa" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.018055] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.018193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.018265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.018361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3cbbdfa-6b3b-4178-9dd8-4aa9e6aa524e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.018494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.018613] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.018684] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.018781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac44685-7555-444d-b1ce-19ece671a825" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.062433] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e992527-e74e-4251-a2db-cbb2515a8605: rpc.has_security_group_logging(os_id): False [ 1391.094987] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.095174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.095234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.095524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.101047] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1110e864-8fe2-4147-ac63-04a6f0d7e278: rpc.has_security_group_logging(os_id): False [ 1391.127996] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.128238] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.128361] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.128428] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.128620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.128736] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.128791] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 is going to be updated. [ 1391.147580] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.149689] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.149825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.149916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.150158] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.157664] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.157784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.220960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.221548] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.221548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.221548] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.221715] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.222109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.222109] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be updated. [ 1391.222933] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.223137] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.223267] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.223448] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d880077d-b1e8-47fa-bc09-7da9308456b0" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.289539] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.289711] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.289759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.289980] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.290156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.318315] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: IN_PROGRESS for 2s [ 1391.358034] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.358034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.358034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.358353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.358905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.390301] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: IN_PROGRESS for 2s [ 1391.650171] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.650436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.650436] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.650739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.650904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.651094] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1391.687915] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.688147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.688204] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.688447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.688608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.698835] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1393.063885] env[70032]: INFO networking_nsxv3.common.synchronization [req-429413d0-0627-4aa4-9175-5112c037933a req-e85772dd-fe24-4c26-8e6b-3b906488b1fc tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_members [ 1393.064382] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e992527-e74e-4251-a2db-cbb2515a8605 with Priority: HIGHEST for action security_group_members [ 1393.064685] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e992527-e74e-4251-a2db-cbb2515a8605 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.064839] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.064897] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.065081] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.065229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.065328] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.065384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.065669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.065669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.065799] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e992527-e74e-4251-a2db-cbb2515a8605',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.334728] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: SUCCESS [ 1393.334903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.404745] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1393.404975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.568530] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.568777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.568777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.568975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.569091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.569281] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.569376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.569439] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.569595] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.569702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.569767] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 is going to be updated. [ 1393.597468] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.597647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.597697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.597880] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.598029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.606691] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: IN_PROGRESS for 2s [ 1393.708149] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1393.708399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.708589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.708818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.709853] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.709853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.709853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.709853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.709853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.709853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.709853] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.096065] env[70032]: INFO networking_nsxv3.common.synchronization [req-4353e6e0-90a6-48af-9dec-0bf6af21b7d1 req-6741d6e8-049d-4ca3-877c-19dc27cd9b6e tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1394.098017] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1394.098017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.098017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.098017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.098017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.098017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.098017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.098017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.098017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.098017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.098017] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.212432] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.601370] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.601584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.601627] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.601942] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.622062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.622062] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.622062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.622062] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.622370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.622370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.622579] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1394.645116] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.645335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.645404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.645792] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.645941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.653531] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1394.718059] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d6919e6-e32b-4e99-b10c-70b263dc0104: rpc.has_security_group_logging(os_id): False [ 1394.737944] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.739705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.739705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.739705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.756988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.757112] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.757218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.757298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.757680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.757680] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.757680] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1394.810220] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.810461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.810586] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.810917] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.811144] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.823930] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1395.618250] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e992527-e74e-4251-a2db-cbb2515a8605 in Status: SUCCESS [ 1395.618643] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e992527-e74e-4251-a2db-cbb2515a8605 deletion is rescheduled due to dependency. [ 1395.618643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e992527-e74e-4251-a2db-cbb2515a8605" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.666198] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1396.666580] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d deletion is rescheduled due to dependency. [ 1396.666580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.842083] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1396.842351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.887523] env[70032]: INFO networking_nsxv3.common.synchronization [req-dcb91f6f-bdfb-466d-8f4f-07461c118c52 req-2ad93c9b-efbe-4241-8af2-fc2212308082 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1396.888082] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1396.888397] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.888520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.888593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.888810] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.888977] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.889082] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.889225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.889380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.889469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.889562] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.391686] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.497690] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.497923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.498024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.498306] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.499032] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.499243] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.499243] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.499507] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.499632] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.499874] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1397.499975] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1397.500102] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1397.500228] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1397.500331] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1397.500439] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1397.500579] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1397.521456] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1397.521696] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1397.521847] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1397.522042] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-215" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.522397] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-1b88324b-2cbd-4607-848d-8884e51d8a8a taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.522578] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.522702] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.523119] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.523289] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b88324b-2cbd-4607-848d-8884e51d8a8a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.894223] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.025894] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.026179] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.026360] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.026708] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.026920] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.027127] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 1b88324b-2cbd-4607-848d-8884e51d8a8a not found, creating... [ 1398.027423] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.027622] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.027780] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.028031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.028209] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.028535] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.028702] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.028833] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.029092] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.029247] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.029397] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 1b88324b-2cbd-4607-848d-8884e51d8a8a is going to be created. [ 1398.051367] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.051599] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.051731] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.051980] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.052227] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.052476] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.395927] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.396307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.396441] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.396639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.396803] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.396982] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1398.422549] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.422900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.422900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.423090] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.423272] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.431336] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1398.852763] env[70032]: INFO networking_nsxv3.common.synchronization [req-dcb91f6f-bdfb-466d-8f4f-07461c118c52 req-3c49fdcf-e472-4618-8922-11409dc11575 service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1398.853068] env[70032]: INFO networking_nsxv3.common.synchronization [req-dcb91f6f-bdfb-466d-8f4f-07461c118c52 req-3c49fdcf-e472-4618-8922-11409dc11575 service nova] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1398.853141] env[70032]: INFO networking_nsxv3.common.synchronization [req-dcb91f6f-bdfb-466d-8f4f-07461c118c52 req-3c49fdcf-e472-4618-8922-11409dc11575 service nova] Enqueued Resource ID: 1b88324b-2cbd-4607-848d-8884e51d8a8a with Priority: HIGHEST for action port [ 1398.853726] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_rules [ 1398.853892] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1398.853958] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b88324b-2cbd-4607-848d-8884e51d8a8a with Priority: HIGHEST for action port [ 1398.854345] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.854345] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.854480] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.854625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.854701] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.856017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.856120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.856328] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b88324b-2cbd-4607-848d-8884e51d8a8a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.856423] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.856562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.856663] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.856742] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b88324b-2cbd-4607-848d-8884e51d8a8a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.357387] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.357777] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.359917] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b88324b-2cbd-4607-848d-8884e51d8a8a with status ACTIVE [ 1399.360145] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.360352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.360453] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.360696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.361475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.361563] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.361624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.361695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.361932] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.362070] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.362516] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.362516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.362678] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.362798] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.362903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.363018] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b88324b-2cbd-4607-848d-8884e51d8a8a is going to be updated. [ 1399.384093] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.384327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.384327] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.384927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.384927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.384927] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b88324b-2cbd-4607-848d-8884e51d8a8a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.578469] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.578681] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.578810] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.579098] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.579361] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.579775] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.579923] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.580173] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.580327] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.580539] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1399.580753] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1399.580753] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1399.580907] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1399.581045] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1399.581158] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1399.581331] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1399.598974] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1399.599198] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1399.599416] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1399.599593] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-534" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.599908] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.600095] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.600221] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.600566] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.600711] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72084fe6-7bf0-405b-a43e-b1ce47b49e6e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.103977] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.104361] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.104550] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.104857] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.105065] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.105496] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.105783] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.106015] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.106442] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.106686] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.107017] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.107197] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.107437] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.107753] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.107916] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.108084] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e is going to be updated. [ 1400.130618] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.130868] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.130985] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.131316] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.131593] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.131828] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.443239] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1400.443512] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.443632] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.443858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.444074] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.444185] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.444254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.444410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.444497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.444589] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.851676] env[70032]: INFO networking_nsxv3.common.synchronization [req-7d6708ee-40b6-43c4-975d-d35abfb09406 req-1d03ac4c-0793-46de-b97d-1546564eb057 service nova] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1400.851878] env[70032]: INFO networking_nsxv3.common.synchronization [req-7d6708ee-40b6-43c4-975d-d35abfb09406 req-1d03ac4c-0793-46de-b97d-1546564eb057 service nova] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1400.852051] env[70032]: INFO networking_nsxv3.common.synchronization [req-7d6708ee-40b6-43c4-975d-d35abfb09406 req-1d03ac4c-0793-46de-b97d-1546564eb057 service nova] Enqueued Resource ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e with Priority: HIGHEST for action port [ 1400.852316] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_rules [ 1400.852468] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1400.852566] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e with Priority: HIGHEST for action port [ 1400.854852] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.855164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.855164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.855368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.855532] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.856350] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.856476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.856539] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.856704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.856985] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.857068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.857068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.857217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.857334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.857462] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.858563] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.858563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.858563] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.858714] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.858714] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72084fe6-7bf0-405b-a43e-b1ce47b49e6e',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.948236] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.360862] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.361015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.361292] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72084fe6-7bf0-405b-a43e-b1ce47b49e6e with status ACTIVE [ 1401.361511] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.361626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.361690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.361894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.361985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.362163] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.362256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.362312] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.362490] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.362573] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.362755] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.362846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.362902] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.363052] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.363128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.363210] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72084fe6-7bf0-405b-a43e-b1ce47b49e6e is going to be updated. [ 1401.364294] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.383565] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.383730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.383773] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.384009] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.384164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.384368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72084fe6-7bf0-405b-a43e-b1ce47b49e6e" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.450551] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.867359] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.954017] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.954017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.954017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.954017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.954017] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.954017] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1401.981676] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.981819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.981891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.982109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.982257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.990429] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1402.059012] env[70032]: INFO networking_nsxv3.common.synchronization [None req-fdfaf496-0e17-4dd7-8f62-38db5ce7bd63 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_rules [ 1402.059072] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_rules [ 1402.059387] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.059476] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.059569] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.059800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.059890] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.174302] env[70032]: INFO networking_nsxv3.common.synchronization [None req-9a210e44-01ce-49fb-9e60-3ad0b86b5cf3 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_rules [ 1402.174636] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_rules [ 1402.174940] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.175056] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.372248] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.372248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.372248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.372248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.372248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.372248] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 is going to be updated. [ 1402.398128] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.398372] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.398455] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.398692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.398845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.408139] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: IN_PROGRESS for 2s [ 1402.580697] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.581576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.581576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.581576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.581576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.581576] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 already deleted. [ 1402.581576] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.582053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.582053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.582053] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.101212] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.101403] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.101479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.101693] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.101781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.101878] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 already deleted. [ 1403.101958] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.999745] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1404.000072] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.000230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.000471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.000715] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.000862] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.000937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.001154] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.001286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.001391] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.001512] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.417841] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: SUCCESS [ 1404.418130] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.418320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.418546] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.418738] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.418858] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.418922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.419089] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.419170] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.419257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.419366] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.504122] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.504315] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.504375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.504557] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.504718] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.504818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.504876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.505040] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.505127] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.505217] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.505361] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.505454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.505514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.505650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.505805] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.505891] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.505948] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.506091] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.506165] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.506246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.506330] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.925387] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.008643] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3009f70d-c184-49eb-851b-1a0b6b0a658c: rpc.has_security_group_logging(os_id): False [ 1405.025560] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.025718] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.025791] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.025959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.041971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.042228] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.042374] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.042470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.042695] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.042784] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.042997] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.043113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.043176] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.043322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.043400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.043578] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.043668] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.043726] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.043868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.043943] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.044049] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1405.108651] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.108941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.108941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.109202] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.109353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.126333] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1405.427522] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 089211d0-0678-4d8a-b45b-5e832cf3a642: rpc.has_security_group_logging(os_id): False [ 1405.445038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.445252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.445362] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.445540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.445638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.446257] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.446257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.446257] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.446603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.446603] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.446603] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 is going to be created. [ 1405.511808] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.512061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.512061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.512380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.512707] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.526086] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: IN_PROGRESS for 2s [ 1405.656449] env[70032]: INFO networking_nsxv3.common.synchronization [req-ed809187-1a63-4327-8b90-60eacd7382e2 req-4e263da7-aa7e-4175-9aa5-0f9db0de89f8 tempest-ServerActionsTestOtherB-187487878 tempest-ServerActionsTestOtherB-187487878-project-member] Enqueued Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1405.659904] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 with Priority: HIGHEST for action security_group_members [ 1405.660287] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d6919e6-e32b-4e99-b10c-70b263dc0104 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.660410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.660484] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.660690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.660847] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.660959] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.661063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.661198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.661329] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.661410] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d6919e6-e32b-4e99-b10c-70b263dc0104',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.167780] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.167780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.167780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.167780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.168296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.168296] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.168296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.168296] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.168445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.168445] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.168507] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 is going to be updated. [ 1406.193956] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.194125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.194182] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.194377] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.194518] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.202439] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: IN_PROGRESS for 2s [ 1407.145147] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1407.145219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.323116] env[70032]: INFO networking_nsxv3.common.synchronization [req-c4d01c0e-a5ff-474d-b4ce-ad80acd82691 req-4607e2a1-3ace-4893-b4b8-b5872d5ec556 tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1407.323809] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1407.324204] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.324347] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.324446] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.324667] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.324904] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.325060] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.325310] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.325592] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.325762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.325978] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.545539] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: SUCCESS [ 1407.545904] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.630135] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.630349] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.630478] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.630755] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.632837] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.633522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.633522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.633522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.633728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.634029] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.634211] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1407.634345] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1407.634465] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1407.634586] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1407.634704] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1407.634907] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1407.654367] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1407.654556] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1407.654705] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1407.654897] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.655265] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-49c19880-be40-478d-b673-8423181a9a3a taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.655454] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.655628] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.655979] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.656064] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49c19880-be40-478d-b673-8423181a9a3a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.828394] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.828604] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.828654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.828848] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.828944] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.829159] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.829302] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.829366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.829523] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.829602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.829690] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1407.861183] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.861440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.861568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.861802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.861956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.872884] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1408.158847] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.158847] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.159192] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.159443] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.159630] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.159799] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 49c19880-be40-478d-b673-8423181a9a3a not found, creating... [ 1408.160207] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.160392] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.160522] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.160765] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.160909] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.161386] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.161568] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.161691] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.161957] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.162069] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.162357] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 49c19880-be40-478d-b673-8423181a9a3a is going to be created. [ 1408.183957] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.184165] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.184300] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.184595] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.184837] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.185084] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.219590] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 in Status: SUCCESS [ 1408.219835] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d6919e6-e32b-4e99-b10c-70b263dc0104 deletion is rescheduled due to dependency. [ 1408.220015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d6919e6-e32b-4e99-b10c-70b263dc0104" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.884688] env[70032]: INFO networking_nsxv3.common.synchronization [req-c4d01c0e-a5ff-474d-b4ce-ad80acd82691 req-86355f23-0904-478c-bc55-114ea6067487 service nova] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1408.884945] env[70032]: INFO networking_nsxv3.common.synchronization [req-c4d01c0e-a5ff-474d-b4ce-ad80acd82691 req-86355f23-0904-478c-bc55-114ea6067487 service nova] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1408.885037] env[70032]: INFO networking_nsxv3.common.synchronization [req-c4d01c0e-a5ff-474d-b4ce-ad80acd82691 req-86355f23-0904-478c-bc55-114ea6067487 service nova] Enqueued Resource ID: 49c19880-be40-478d-b673-8423181a9a3a with Priority: HIGHEST for action port [ 1408.885274] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1408.885401] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1408.885499] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49c19880-be40-478d-b673-8423181a9a3a with Priority: HIGHEST for action port [ 1408.886076] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.886208] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.886271] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.886477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.886559] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.887414] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.887516] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.887714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-49c19880-be40-478d-b673-8423181a9a3a taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.887826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.887890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.888076] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.888153] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49c19880-be40-478d-b673-8423181a9a3a',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.389920] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.390057] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.390274] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49c19880-be40-478d-b673-8423181a9a3a with status ACTIVE [ 1409.390448] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.390554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.390621] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.390829] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.390918] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.391095] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.391191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.391254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.391470] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.391540] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.391719] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.391813] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.391873] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.392034] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.392113] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.392197] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49c19880-be40-478d-b673-8423181a9a3a is going to be updated. [ 1409.412320] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.412461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.412534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.412947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.412947] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.413193] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49c19880-be40-478d-b673-8423181a9a3a" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.568588] env[70032]: INFO networking_nsxv3.common.synchronization [req-de0ea3f3-5c8b-41b0-a895-a7195a1e7ded req-36a905f6-05a0-4165-bba4-ae4c2c58e8b8 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_members [ 1409.569579] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_members [ 1409.569903] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.570225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.570365] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.570654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.570879] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.571063] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.571177] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.571427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.571570] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.571708] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.877420] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.877618] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.877749] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.878034] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.878296] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.878459] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.878581] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.878804] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.878956] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.879184] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.879325] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1409.879414] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1409.879528] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1409.879639] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.879749] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1409.879884] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1409.882198] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1409.882747] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d deletion is rescheduled due to dependency. [ 1409.882747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.882747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.882747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.882970] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.883036] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.883077] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.883191] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.883263] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.883354] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.896151] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1409.896426] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1409.896473] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1409.896594] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.896861] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.897038] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.897150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.897420] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.897565] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7f89f3-7b19-48e9-8001-64e5fc2e71c9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.073899] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.073899] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.074129] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.074205] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.074299] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.074515] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.074638] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.074682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.074821] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.074893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.074971] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 already deleted. [ 1410.075061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.385848] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.400451] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.400451] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.400451] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.400671] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.400711] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.400860] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 not found, creating... [ 1410.401138] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.401301] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.401510] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.401733] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.401879] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.402179] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.402370] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.402506] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.402718] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.402859] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.403013] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 is going to be created. [ 1410.420824] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.421017] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.421151] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.421437] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.421657] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.421874] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.888186] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.143295] env[70032]: INFO networking_nsxv3.common.synchronization [req-de0ea3f3-5c8b-41b0-a895-a7195a1e7ded req-aec3a280-3e90-4b82-986c-66ffff536b68 service nova] Enqueued Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_rules [ 1411.143624] env[70032]: INFO networking_nsxv3.common.synchronization [req-de0ea3f3-5c8b-41b0-a895-a7195a1e7ded req-aec3a280-3e90-4b82-986c-66ffff536b68 service nova] Enqueued Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_members [ 1411.143624] env[70032]: INFO networking_nsxv3.common.synchronization [req-de0ea3f3-5c8b-41b0-a895-a7195a1e7ded req-aec3a280-3e90-4b82-986c-66ffff536b68 service nova] Enqueued Resource ID: 1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 with Priority: HIGHEST for action port [ 1411.143879] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_rules [ 1411.143970] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_members [ 1411.144082] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 with Priority: HIGHEST for action port [ 1411.144646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.144769] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.144836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.145274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.145402] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.146564] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.146725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.146797] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.146985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.147265] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.147393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.147471] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.147617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.147704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.147807] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.149389] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.149511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.149593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.149861] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.149957] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7f89f3-7b19-48e9-8001-64e5fc2e71c9',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.390833] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.391088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.391088] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.391305] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.391474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.391555] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1411.420113] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.420321] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.420392] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.420551] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.420696] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.430656] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1411.648274] env[70032]: INFO networking_nsxv3.common.synchronization [req-8643bfb3-862c-4a1b-8114-88758570e42c req-0878fecc-c086-4f25-8952-d624e4383abc tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1411.648806] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1411.649161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.649306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.649407] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.649574] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.649731] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.649826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.649884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.653038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.653038] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.653038] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.653038] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.653038] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 with status ACTIVE [ 1411.653581] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.653581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.653725] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.653900] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.654105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.654318] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.654493] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.654568] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.654730] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.654814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.655013] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.655108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.655181] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.655318] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.655397] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.655483] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e7f89f3-7b19-48e9-8001-64e5fc2e71c9 is going to be updated. [ 1411.660028] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.660028] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.679053] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.679053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.679053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.679053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.679053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.679053] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e7f89f3-7b19-48e9-8001-64e5fc2e71c9" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.153820] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.158174] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.657397] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.659810] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.660987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.660987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.660987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.660987] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.660987] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 is going to be created. [ 1412.684825] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.685030] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.685538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.685538] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.686477] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.697089] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 in Status: UNINITIALIZED for 2s [ 1413.159822] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.160171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.160171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.160330] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.160371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.160447] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1413.202030] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.202174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.202174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.202396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.202746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.219279] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1413.441369] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1413.441834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.442084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.442353] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.442598] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.442742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.442817] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.443021] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.443128] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.443247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.443343] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.945690] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.448525] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f8ad78a-3466-4ff5-8d70-3fec6284010d: rpc.has_security_group_logging(os_id): False [ 1414.467838] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.467967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.468051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.468287] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.468399] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.468669] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.468814] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.468868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.469016] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.469122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.469241] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1414.523098] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.523249] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.523320] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.523511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.523657] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.534295] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1414.707745] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 in Status: SUCCESS [ 1414.707972] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.708155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.708368] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.708583] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.708699] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.708751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.708914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.709035] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.709108] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.709204] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.211220] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.229371] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1415.229641] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.713959] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1befe5b-c9d9-4f95-b089-a7c99609a7a2: rpc.has_security_group_logging(os_id): False [ 1415.731122] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.731279] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.731351] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.731631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.731741] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.731993] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.732124] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.732194] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.732878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.732878] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.732878] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 is going to be created. [ 1415.807919] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.808135] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.808188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.808371] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.808556] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.819917] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 in Status: IN_PROGRESS for 2s [ 1416.546468] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1416.546468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.650427] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.650546] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1417.831506] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 in Status: SUCCESS [ 1417.831885] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.925211] env[70032]: INFO networking_nsxv3.common.synchronization [req-987f1c89-86ae-452c-aad1-76d904dfafae req-d64ab7c2-aa8e-4b2a-ac3c-c6b60d60fa56 tempest-ServersTestJSON-712040656 tempest-ServersTestJSON-712040656-project-member] Enqueued Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1417.926037] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c with Priority: HIGHEST for action security_group_members [ 1417.926037] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3009f70d-c184-49eb-851b-1a0b6b0a658c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.926973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.926973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.926973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.926973] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.926973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.926973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.926973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.926973] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.927585] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3009f70d-c184-49eb-851b-1a0b6b0a658c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.429646] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.429816] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.429892] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.430142] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.430240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.430458] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.430542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.430605] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.430756] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.430834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.430920] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c is going to be updated. [ 1418.456511] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.456511] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.456705] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.456826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.456997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.464921] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: IN_PROGRESS for 2s [ 1420.475594] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c in Status: SUCCESS [ 1420.475913] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3009f70d-c184-49eb-851b-1a0b6b0a658c deletion is rescheduled due to dependency. [ 1420.475945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3009f70d-c184-49eb-851b-1a0b6b0a658c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.927405] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.927716] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.928773] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.929101] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1432.929907] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.930115] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.931240] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.931577] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.932183] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.932440] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.091264] env[70032]: INFO networking_nsxv3.common.synchronization [req-63b79f35-cbaa-42ac-a456-fa4c65c439fb req-e1ca210c-9c1c-494a-9309-7faf4bf02173 tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_members [ 1447.091629] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d with Priority: HIGHEST for action security_group_members [ 1447.091974] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.092109] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.092178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.092375] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.092523] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.092618] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.092681] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.092856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.092956] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.093044] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0492d1cb-b735-4632-8c66-1d2fadd7ef6d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.595094] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.595286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.595381] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.595645] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.615265] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.615501] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.615620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.615697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.615910] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.615997] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.616110] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d is going to be updated. [ 1447.641471] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.641654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.641654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.641853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.641986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.649560] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d in Status: IN_PROGRESS for 2s [ 1449.660067] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d in Status: SUCCESS [ 1449.660067] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0492d1cb-b735-4632-8c66-1d2fadd7ef6d deletion is rescheduled due to dependency. [ 1449.660454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0492d1cb-b735-4632-8c66-1d2fadd7ef6d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.093017] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.093253] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.601621] env[70032]: INFO networking_nsxv3.common.synchronization [req-15a96132-9521-46c7-89b5-7fd87ac6db5f req-b33b8066-8113-461d-8317-ab38aec44dd4 tempest-AttachVolumeShelveTestJSON-695244188 tempest-AttachVolumeShelveTestJSON-695244188-project-member] Enqueued Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1453.603176] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 with Priority: HIGHEST for action security_group_members [ 1453.604448] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-089211d0-0678-4d8a-b45b-5e832cf3a642 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.604713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.604713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.604919] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.605091] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.605189] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.605248] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.605413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.605497] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.605593] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('089211d0-0678-4d8a-b45b-5e832cf3a642',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.113161] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.113366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.113408] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.113642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.113740] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.113934] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.114044] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.114136] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.114259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.114334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.114423] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 is going to be updated. [ 1454.140423] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.140601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.140648] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.140834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.140984] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.148635] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: IN_PROGRESS for 2s [ 1456.159258] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 in Status: SUCCESS [ 1456.159617] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 089211d0-0678-4d8a-b45b-5e832cf3a642 deletion is rescheduled due to dependency. [ 1456.159617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-089211d0-0678-4d8a-b45b-5e832cf3a642" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.581803] env[70032]: INFO networking_nsxv3.common.synchronization [req-4210272b-abfb-44aa-a0b1-b6ad3361d69b req-52a5672a-5cea-4e70-80dc-62f09301c885 tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1456.582649] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1456.582747] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.582869] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.582945] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.583164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.583316] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.583411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.583475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.583615] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.583697] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.583787] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.826665] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.826869] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.827038] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.827276] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.827539] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.827700] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.827822] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.828118] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.828289] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.828499] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1456.828618] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1456.828735] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1456.828851] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1456.828966] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1456.829090] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1456.829294] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1456.851507] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1456.851507] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1456.851624] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1456.851895] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.852203] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-e53a4190-c758-4ff4-be8b-819d8503eaa8 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.852390] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.852515] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.852915] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.853095] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e53a4190-c758-4ff4-be8b-819d8503eaa8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.085692] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.085845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.085914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.086175] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.086286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.086489] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.086594] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.086658] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.086809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.086888] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.086975] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be deleted. [ 1457.116910] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.117058] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.117125] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.117300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.117385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.117479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.356114] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.356114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.356114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.356114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.356565] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.356565] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port e53a4190-c758-4ff4-be8b-819d8503eaa8 not found, creating... [ 1457.356711] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.356860] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.356982] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.357221] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.357366] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.357665] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.357857] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.357983] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.358207] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.358444] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.358522] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: e53a4190-c758-4ff4-be8b-819d8503eaa8 is going to be created. [ 1457.377709] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.377907] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.378031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.378280] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.378498] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.378715] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.071261] env[70032]: INFO networking_nsxv3.common.synchronization [req-4210272b-abfb-44aa-a0b1-b6ad3361d69b req-f32435cb-4b8b-44dc-82c1-ec3d42513e9f service nova] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_rules [ 1458.071537] env[70032]: INFO networking_nsxv3.common.synchronization [req-4210272b-abfb-44aa-a0b1-b6ad3361d69b req-f32435cb-4b8b-44dc-82c1-ec3d42513e9f service nova] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1458.071588] env[70032]: INFO networking_nsxv3.common.synchronization [req-4210272b-abfb-44aa-a0b1-b6ad3361d69b req-f32435cb-4b8b-44dc-82c1-ec3d42513e9f service nova] Enqueued Resource ID: e53a4190-c758-4ff4-be8b-819d8503eaa8 with Priority: HIGHEST for action port [ 1458.071811] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_rules [ 1458.071981] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1458.072105] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e53a4190-c758-4ff4-be8b-819d8503eaa8 with Priority: HIGHEST for action port [ 1458.072667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.072794] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.072856] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.073180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.073272] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.074097] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.074213] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.074281] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.074457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.074619] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.074690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.074739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.074887] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.074998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.075101] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.076112] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e53a4190-c758-4ff4-be8b-819d8503eaa8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.076225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.076295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.076447] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.076520] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e53a4190-c758-4ff4-be8b-819d8503eaa8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.579306] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.579633] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.579633] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.580957] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e53a4190-c758-4ff4-be8b-819d8503eaa8 with status ACTIVE [ 1458.581160] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.581274] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.581363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.581531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.581619] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.582306] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.582306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.582306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.582306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.582306] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.582534] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.582534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.582534] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.582650] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.583309] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.583309] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e53a4190-c758-4ff4-be8b-819d8503eaa8 is going to be updated. [ 1458.602787] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.602971] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.603065] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.603290] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.603443] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.603622] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.082321] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.587041] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.587041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.587041] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.587396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.587396] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.587396] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be created. [ 1459.609793] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.609793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.609793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.609793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.610363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.618618] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: UNINITIALIZED for 2s [ 1461.629697] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: SUCCESS [ 1461.630097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.630097] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.630295] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.630482] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.630601] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.630669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.630823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.630906] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.630994] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.631097] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.133957] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.134184] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.134288] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.134533] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.134709] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.134863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.134923] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.135105] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.135252] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.135356] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.135510] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.135607] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.135694] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.135843] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.136045] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.136155] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.136218] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.136389] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.136643] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.136739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.136832] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.638875] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f5dd232-e552-483f-8e40-b495ebe5e511: rpc.has_security_group_logging(os_id): False [ 1462.659123] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.659283] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.659354] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.659562] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.659652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.659867] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.659985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.660064] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.660215] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.660294] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.660512] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.660611] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.660673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.660815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.660890] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.661079] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.661172] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.661230] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.661364] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.661437] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.661958] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be created. [ 1462.717667] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.717842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.717842] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.718015] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.718198] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.730269] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: IN_PROGRESS for 2s [ 1463.073386] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.073513] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1464.744059] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: SUCCESS [ 1464.744419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.396269] env[70032]: INFO networking_nsxv3.common.synchronization [req-8e0136f8-8eaa-4a18-9238-096e031e21ff req-dad29d8f-a52a-47f2-85d2-d8b6e69e0c8f tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1465.397136] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 with Priority: HIGHEST for action security_group_members [ 1465.397462] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f5dd232-e552-483f-8e40-b495ebe5e511 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.398259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.398259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.398259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.398259] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.398370] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.398505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.398642] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.398751] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.398859] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f5dd232-e552-483f-8e40-b495ebe5e511',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.446033] env[70032]: INFO networking_nsxv3.common.synchronization [req-8e0136f8-8eaa-4a18-9238-096e031e21ff req-dad29d8f-a52a-47f2-85d2-d8b6e69e0c8f tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: e53a4190-c758-4ff4-be8b-819d8503eaa8 with Priority: HIGHEST for action port [ 1465.446935] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e53a4190-c758-4ff4-be8b-819d8503eaa8 with Priority: HIGHEST for action port [ 1465.447660] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-e53a4190-c758-4ff4-be8b-819d8503eaa8 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.447922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.448116] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.448363] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.448416] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e53a4190-c758-4ff4-be8b-819d8503eaa8',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.901937] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.902222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.902222] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.902406] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.902500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.902693] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.902790] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.902853] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.903011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.903096] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.903193] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 is going to be updated. [ 1465.942295] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.942431] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.942554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.942745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.942808] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.951752] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: IN_PROGRESS for 2s [ 1465.952251] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e53a4190-c758-4ff4-be8b-819d8503eaa8 with status ACTIVE [ 1465.952251] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.952385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.952385] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.952520] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.952608] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.952779] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.952876] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.952967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.953159] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.953244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.953430] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.953599] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.953704] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.953852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.953940] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.954024] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e53a4190-c758-4ff4-be8b-819d8503eaa8 is going to be updated. [ 1465.971823] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.971963] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.972452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.972452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.972452] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.972578] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e53a4190-c758-4ff4-be8b-819d8503eaa8" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.961772] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 in Status: SUCCESS [ 1467.962234] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f5dd232-e552-483f-8e40-b495ebe5e511 deletion is rescheduled due to dependency. [ 1467.962234] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f5dd232-e552-483f-8e40-b495ebe5e511" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.447855] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.448222] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.352333] env[70032]: INFO networking_nsxv3.common.synchronization [req-3d20b2f0-e8cb-4b59-88a5-9794fc9d3100 req-01d98e25-f882-46bd-99bb-f29e74122a12 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_members [ 1473.352877] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 with Priority: HIGHEST for action security_group_members [ 1473.353229] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.353376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.353419] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.353612] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.353762] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.353860] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.353920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.354084] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.354173] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.354333] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1befe5b-c9d9-4f95-b089-a7c99609a7a2',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.858048] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.858048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.858048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.858048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.858048] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.858324] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.858324] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.858398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.858510] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.858584] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.858672] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 is going to be updated. [ 1473.883760] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.883926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.883965] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.884156] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.884300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.891643] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 in Status: IN_PROGRESS for 2s [ 1475.905234] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 in Status: SUCCESS [ 1475.905631] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1befe5b-c9d9-4f95-b089-a7c99609a7a2 deletion is rescheduled due to dependency. [ 1475.905631] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1befe5b-c9d9-4f95-b089-a7c99609a7a2" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.096916] env[70032]: INFO networking_nsxv3.common.synchronization [None req-01d73efa-372a-4539-a56d-aedf48db8127 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_rules [ 1478.097664] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_rules [ 1478.097974] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.098432] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.098506] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.098759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.099056] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.163803] env[70032]: INFO networking_nsxv3.common.synchronization [None req-09d297fe-c0c7-4e08-a3c8-c6b6ef88b116 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_rules [ 1478.164334] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_rules [ 1478.164649] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.164753] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.620708] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.620872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.620916] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.621246] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.621343] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.621639] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c already deleted. [ 1478.621639] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.621781] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.621922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.622083] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1479.143482] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.143780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.143780] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.143884] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.143977] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.144103] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c already deleted. [ 1479.144190] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.165165] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.165406] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.318659] env[70032]: INFO networking_nsxv3.common.synchronization [req-88d0aa15-a429-4217-a832-c397a41c326c req-f4c4a5bb-7526-4acd-953b-450997f8a11c tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_members [ 1486.318839] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_members [ 1486.319554] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.319554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.319554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.319554] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.319849] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.319849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.319849] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.319993] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.320099] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.320222] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.619031] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.619031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.619031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.619031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.619031] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.619338] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.619338] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.619496] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.619648] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.619861] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1486.619977] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1486.620121] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1486.620236] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1486.620352] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1486.620461] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1486.620597] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1486.639533] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1486.639695] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1486.639837] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1486.640024] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-876" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.640356] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-3fa55da2-fa89-4e27-826f-f8ad624257e3 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.640532] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.640653] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.640958] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.641147] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa55da2-fa89-4e27-826f-f8ad624257e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.822215] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.822413] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.822494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.822764] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.822863] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.823070] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.823174] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.823239] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.823393] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.823475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.823561] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c already deleted. [ 1486.823640] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.143635] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.143827] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.143931] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.144242] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.144406] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.144575] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 3fa55da2-fa89-4e27-826f-f8ad624257e3 not found, creating... [ 1487.144846] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.145017] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.145147] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.145376] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.145517] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.145853] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.146031] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.146157] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.146374] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.146514] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.146659] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 3fa55da2-fa89-4e27-826f-f8ad624257e3 is going to be created. [ 1487.165395] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.165568] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.165699] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.165938] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.166181] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.166416] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.832796] env[70032]: INFO networking_nsxv3.common.synchronization [req-88d0aa15-a429-4217-a832-c397a41c326c req-7b4fabf8-56d0-4c0b-8aa0-28f21b681410 service nova] Enqueued Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_rules [ 1487.833099] env[70032]: INFO networking_nsxv3.common.synchronization [req-88d0aa15-a429-4217-a832-c397a41c326c req-7b4fabf8-56d0-4c0b-8aa0-28f21b681410 service nova] Enqueued Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_members [ 1487.833149] env[70032]: INFO networking_nsxv3.common.synchronization [req-88d0aa15-a429-4217-a832-c397a41c326c req-7b4fabf8-56d0-4c0b-8aa0-28f21b681410 service nova] Enqueued Resource ID: 3fa55da2-fa89-4e27-826f-f8ad624257e3 with Priority: HIGHEST for action port [ 1487.833661] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_rules [ 1487.833863] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_members [ 1487.833898] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa55da2-fa89-4e27-826f-f8ad624257e3 with Priority: HIGHEST for action port [ 1487.834298] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.834487] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.834589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.834820] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.834939] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.835817] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.835964] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.836073] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.836346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.836474] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.836602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.836690] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.836868] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.836986] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.837114] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.838252] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fa55da2-fa89-4e27-826f-f8ad624257e3 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.838405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.838501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.838692] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.838794] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa55da2-fa89-4e27-826f-f8ad624257e3',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.340826] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.340960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.341183] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.342215] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fa55da2-fa89-4e27-826f-f8ad624257e3 with status ACTIVE [ 1488.342341] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.342456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.342524] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.342728] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.342818] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.342990] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.343167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.343167] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.343311] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.343411] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.343558] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.343652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.343713] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.343852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.343926] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.344016] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fa55da2-fa89-4e27-826f-f8ad624257e3 is going to be updated. [ 1488.363721] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.363866] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.363920] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.364123] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.364259] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.364415] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fa55da2-fa89-4e27-826f-f8ad624257e3" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.846066] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.347851] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.348092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.348092] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.348410] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.348553] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.348617] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c is going to be created. [ 1489.375177] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.375323] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.375380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.375587] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.375746] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.386706] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c in Status: UNINITIALIZED for 2s [ 1489.752017] env[70032]: INFO networking_nsxv3.common.synchronization [req-3b305ba9-7d12-42b8-a2e0-253995ddd9cf req-34f9ea8c-524c-4d5f-86eb-a244f63ad74a tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1489.752111] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1489.752575] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.752664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.752664] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.752852] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.753043] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.753580] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.753654] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.753815] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.753905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.753999] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.030857] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.031150] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.031197] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.031462] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.031722] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.031878] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.031997] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.032295] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.032571] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.032695] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1490.032812] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1490.032924] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1490.033046] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1490.033162] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1490.033282] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1490.033457] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1490.051445] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1490.051535] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1490.051656] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1490.051809] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-28" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.052120] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.052364] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.052581] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.052851] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.052993] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cbe15ac-9abf-4d67-b8c3-fd11a0499619',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.256096] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.555559] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.555815] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.555955] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.556279] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.556477] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.556647] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 1cbe15ac-9abf-4d67-b8c3-fd11a0499619 not found, creating... [ 1490.556918] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.557093] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.557219] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.557444] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.557588] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.557926] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.558322] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.558495] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.558728] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.558874] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.559052] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 1cbe15ac-9abf-4d67-b8c3-fd11a0499619 is going to be created. [ 1490.577557] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.577744] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.577867] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.578168] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.578406] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.578622] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.758546] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.782055] env[70032]: INFO networking_nsxv3.common.synchronization [req-03b275da-f797-4422-9000-fbad1cf44c71 req-d2f76e92-4287-48f8-8f21-af552dfaab11 tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1490.782730] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1490.783043] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.783221] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.783352] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.783460] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.783614] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.783712] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.783765] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.783914] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.784011] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.784105] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.242571] env[70032]: INFO networking_nsxv3.common.synchronization [req-3b305ba9-7d12-42b8-a2e0-253995ddd9cf req-3dc30212-4db4-4d5a-aecb-cda0f5b20d3b service nova] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1491.242801] env[70032]: INFO networking_nsxv3.common.synchronization [req-3b305ba9-7d12-42b8-a2e0-253995ddd9cf req-3dc30212-4db4-4d5a-aecb-cda0f5b20d3b service nova] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1491.242893] env[70032]: INFO networking_nsxv3.common.synchronization [req-3b305ba9-7d12-42b8-a2e0-253995ddd9cf req-3dc30212-4db4-4d5a-aecb-cda0f5b20d3b service nova] Enqueued Resource ID: 1cbe15ac-9abf-4d67-b8c3-fd11a0499619 with Priority: HIGHEST for action port [ 1491.243132] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_rules [ 1491.243267] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1491.243412] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cbe15ac-9abf-4d67-b8c3-fd11a0499619 with Priority: HIGHEST for action port [ 1491.243961] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.244101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.244171] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.244366] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.244449] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.245543] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.245543] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.245543] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.245819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.245819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.245819] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.245949] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cbe15ac-9abf-4d67-b8c3-fd11a0499619',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.264541] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.264673] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.264745] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.265029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.265029] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.265154] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be updated. [ 1491.285741] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.285881] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.285937] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.286098] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.286188] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.286363] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.286457] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.286521] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.286911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.286911] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.286911] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1491.306763] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.306909] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.306985] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.307122] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.307256] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.317406] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: IN_PROGRESS for 2s [ 1491.332772] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.332930] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.332970] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.333147] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.333298] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.341174] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1491.394583] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c in Status: SUCCESS [ 1491.394772] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.394922] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.395120] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.395293] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.395405] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.395469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.395626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.395702] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.395786] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.395875] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.747611] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.747782] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.747985] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cbe15ac-9abf-4d67-b8c3-fd11a0499619 with status ACTIVE [ 1491.748246] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.748390] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.748468] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.748701] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.748802] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.749038] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.749151] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.749245] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.749346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.749427] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.749626] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.749841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.749841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.749960] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.750047] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.750142] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cbe15ac-9abf-4d67-b8c3-fd11a0499619 is going to be updated. [ 1491.771871] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.772051] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.772143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.772625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.772625] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.772789] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cbe15ac-9abf-4d67-b8c3-fd11a0499619" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.898499] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.401903] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7e3180b-ba0e-4679-86fe-946d98ef9a6c: rpc.has_security_group_logging(os_id): False [ 1492.419941] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.420219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.420219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.420398] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.420501] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.420753] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.420872] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.420928] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.421485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.421485] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.421485] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c is going to be created. [ 1492.480624] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.480624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.480624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.480624] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.480895] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.491020] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c in Status: IN_PROGRESS for 2s [ 1493.326590] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1493.326845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.327069] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.327322] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.327626] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.327823] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.327931] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.328152] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.328251] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.328401] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.348913] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1493.349163] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d deletion is rescheduled due to dependency. [ 1493.349326] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.830879] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.333791] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.504624] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c in Status: SUCCESS [ 1494.504867] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.836923] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.837449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.837449] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.837589] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.837809] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.837961] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be updated. [ 1494.864931] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.865178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.865262] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.865505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.865656] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.875613] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: IN_PROGRESS for 2s [ 1496.245350] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.245350] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1496.886998] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1496.886998] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.887164] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.887801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.887801] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.887801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.887801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.887801] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.888045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.888045] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.888099] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.390931] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.893532] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1110e864-8fe2-4147-ac63-04a6f0d7e278: rpc.has_security_group_logging(os_id): False [ 1497.912854] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.913046] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.913107] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.913314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.913414] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.913664] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.913762] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.913826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.913978] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.914066] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.914151] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be updated. [ 1497.975254] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.975420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.975494] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.975679] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.975822] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.988820] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: IN_PROGRESS for 2s [ 1500.002775] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1500.003143] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.906644] env[70032]: INFO networking_nsxv3.common.synchronization [req-830e94f1-f2c4-41ce-a5a2-f663b518886d req-32727cce-a58c-4425-b37d-db102a39a551 tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1500.907208] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1500.907478] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.907602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.907671] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.907870] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.908105] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.908247] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.908332] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.908505] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.908620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.908788] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.134807] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.135114] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.135190] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.135544] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.135853] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.136057] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.136216] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.136476] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.137039] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.137039] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1501.137039] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] NeedRegenerationException {{(pid=70032) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1501.137172] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] no value, waiting for create lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1501.137200] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] value creation lock acquired {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1501.137297] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] No value present for key: 'zone-id' {{(pid=70032) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1501.137406] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Calling creation function for not-yet-present value {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1501.137539] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1501.157839] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1501.157993] env[70032]: DEBUG dogpile.cache.region [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70032) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1501.158147] env[70032]: DEBUG dogpile.lock [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Released creation lock {{(pid=70032) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1501.158308] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "network-882" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.158580] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b taken with stack trace [, , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.158742] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.158865] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.159215] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.159357] env[70032]: DEBUG networking_nsxv3.api.rpc [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cbc1a1-c8cb-43cc-8fe0-e58dd040724b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.411042] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.411240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.411240] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.411404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.411500] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.411714] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.411841] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.411882] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.412020] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.412095] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.412183] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1501.439164] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.439307] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.439346] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.439499] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.439626] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.447152] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1501.661712] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.661941] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.662059] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.662377] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.662548] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.662716] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Segment Port 91cbc1a1-c8cb-43cc-8fe0-e58dd040724b not found, creating... [ 1501.662988] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.663167] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.663304] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.663550] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.663694] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.663978] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.664161] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.664283] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.664498] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.664638] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.664781] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Resource: SegmentPort with ID: 91cbc1a1-c8cb-43cc-8fe0-e58dd040724b is going to be created. [ 1501.684149] env[70032]: DEBUG networking_nsxv3.common.locking [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.684149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.684149] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.684340] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.684732] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.685070] env[70032]: DEBUG oslo_concurrency.lockutils [None req-579276a2-4280-407e-b1e0-b89134fcd929 None None] Releasing lock "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.539863] env[70032]: INFO networking_nsxv3.common.synchronization [req-830e94f1-f2c4-41ce-a5a2-f663b518886d req-8e48ab17-1c90-4a81-a1a0-65edd9c20963 service nova] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1502.540114] env[70032]: INFO networking_nsxv3.common.synchronization [req-830e94f1-f2c4-41ce-a5a2-f663b518886d req-8e48ab17-1c90-4a81-a1a0-65edd9c20963 service nova] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1502.540214] env[70032]: INFO networking_nsxv3.common.synchronization [req-830e94f1-f2c4-41ce-a5a2-f663b518886d req-8e48ab17-1c90-4a81-a1a0-65edd9c20963 service nova] Enqueued Resource ID: 91cbc1a1-c8cb-43cc-8fe0-e58dd040724b with Priority: HIGHEST for action port [ 1502.540506] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_rules [ 1502.540570] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1502.540636] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91cbc1a1-c8cb-43cc-8fe0-e58dd040724b with Priority: HIGHEST for action port [ 1502.541187] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.541314] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.541384] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.541583] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.541662] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.542537] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.542620] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.542750] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.542844] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.542905] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.543080] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.543148] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91cbc1a1-c8cb-43cc-8fe0-e58dd040724b',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.045100] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.045225] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.045369] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91cbc1a1-c8cb-43cc-8fe0-e58dd040724b with status ACTIVE [ 1503.045551] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.045652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.045722] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.045941] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.046068] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.046308] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.046359] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.046420] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.046682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.046682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.046820] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.046893] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.046952] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.047102] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.047179] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.047261] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91cbc1a1-c8cb-43cc-8fe0-e58dd040724b is going to be updated. [ 1503.066658] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.066811] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.066903] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.067094] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.067469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.067469] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91cbc1a1-c8cb-43cc-8fe0-e58dd040724b" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.457512] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1503.457708] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d deletion is rescheduled due to dependency. [ 1503.457836] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.458014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.458254] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.458450] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.458581] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.458647] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.458826] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.458912] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.459016] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.961896] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.465723] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.968759] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.968759] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.969180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.969180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.969180] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.969287] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1504.997669] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.997669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.997669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.997669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.997669] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.005811] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1507.017334] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1507.017652] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.017739] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.017913] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.018115] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.018237] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.018303] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.018461] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.018544] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.018630] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.018738] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.520742] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.541750] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1507.541880] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1508.024574] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f8ad78a-3466-4ff5-8d70-3fec6284010d: rpc.has_security_group_logging(os_id): False [ 1508.042318] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.042519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.042519] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.042738] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.042833] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.043094] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.043192] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.043255] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.043400] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.043478] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.043564] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1508.101457] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.101617] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.101660] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.101846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.101988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.114062] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1510.128233] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1510.128577] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.542786] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.543205] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.544441] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.544806] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.546301] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.546301] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.546951] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.547371] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.548170] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.548498] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.549845] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.550200] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.550742] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.551074] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.551981] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.552418] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1549.591547] env[70032]: INFO networking_nsxv3.common.synchronization [req-1de9e5e1-5efd-49c2-a1de-1a9df2079237 req-ab77ead5-5875-4d24-b211-e066cf1ea261 tempest-AttachVolumeNegativeTest-274200757 tempest-AttachVolumeNegativeTest-274200757-project-member] Enqueued Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_members [ 1549.591773] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c with Priority: HIGHEST for action security_group_members [ 1549.592085] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.592219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.592286] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.592482] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.592635] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.592727] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.592825] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.592975] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.593085] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.593181] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7e3180b-ba0e-4679-86fe-946d98ef9a6c',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.098456] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.098456] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.098456] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.098456] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c is going to be updated. [ 1550.132608] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.132793] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.132845] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.133033] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.133219] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.141069] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c in Status: IN_PROGRESS for 2s [ 1552.151036] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c in Status: SUCCESS [ 1552.151293] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7e3180b-ba0e-4679-86fe-946d98ef9a6c deletion is rescheduled due to dependency. [ 1552.151334] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7e3180b-ba0e-4679-86fe-946d98ef9a6c" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.592697] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1554.593091] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.593799] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.594199] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.091799] env[70032]: INFO networking_nsxv3.common.synchronization [req-dabdbd6a-4441-42c1-ae4d-316a34f52d5f req-874ce2cc-b8d0-4986-89ba-630c91c30509 tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1562.092314] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1562.092416] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.094061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.094061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.094061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.094061] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.094061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.094061] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.095101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.095101] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.095101] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.142022] env[70032]: INFO networking_nsxv3.common.synchronization [req-b442be0f-c481-4e73-bde8-0ea901d365f0 req-95d43102-c5f5-4a9d-b819-63ca3b4bf89e tempest-ServerActionsTestJSON-1021407375 tempest-ServerActionsTestJSON-1021407375-project-member] Enqueued Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1562.142301] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d with Priority: HIGHEST for action security_group_members [ 1562.142594] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f8ad78a-3466-4ff5-8d70-3fec6284010d taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.142706] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.142770] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.143039] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.143184] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.143277] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.143335] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.143479] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.143560] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.143645] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f8ad78a-3466-4ff5-8d70-3fec6284010d',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.596891] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.648315] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.648495] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.648542] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.648750] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.648846] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.649067] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.649178] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.649244] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.649395] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.649474] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.649562] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d is going to be updated. [ 1562.678010] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.678187] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.678258] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.678454] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.678593] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.686395] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: IN_PROGRESS for 2s [ 1563.099091] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.603276] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.603488] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.603596] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.603834] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.603967] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.604080] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be updated. [ 1563.629279] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.629404] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.629475] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.629662] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.629800] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.637491] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: IN_PROGRESS for 2s [ 1564.695861] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d in Status: SUCCESS [ 1564.696254] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f8ad78a-3466-4ff5-8d70-3fec6284010d deletion is rescheduled due to dependency. [ 1564.696313] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f8ad78a-3466-4ff5-8d70-3fec6284010d" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.647026] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1565.647278] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.142733] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.143024] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.144497] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.144861] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.145644] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.146083] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.262713] env[70032]: INFO networking_nsxv3.common.synchronization [req-9de1ed92-5f31-4ddf-9464-9a28fe82439f req-ac0a5bad-141e-42b4-909a-85d8c97ee3cf tempest-ServerActionsTestOtherA-955435152 tempest-ServerActionsTestOtherA-955435152-project-member] Enqueued Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1579.263286] env[70032]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 with Priority: HIGHEST for action security_group_members [ 1579.263621] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock member-1110e864-8fe2-4147-ac63-04a6f0d7e278 taken with stack trace [, , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.263742] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.263805] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.264014] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.264196] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.264300] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.264367] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.264514] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.264602] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.264723] env[70032]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1110e864-8fe2-4147-ac63-04a6f0d7e278',) {} {{(pid=70032) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1579.767470] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.767682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.767682] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.767894] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.767988] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.768217] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.768316] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.768380] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.768531] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.768606] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.768701] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 is going to be updated. [ 1579.795225] env[70032]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70032) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.795387] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.795440] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.795591] env[70032]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.795747] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.803864] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: IN_PROGRESS for 2s [ 1581.814992] env[70032]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 in Status: SUCCESS [ 1581.815376] env[70032]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1110e864-8fe2-4147-ac63-04a6f0d7e278 deletion is rescheduled due to dependency. [ 1581.815376] env[70032]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1110e864-8fe2-4147-ac63-04a6f0d7e278" {{(pid=70032) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.264907] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.264907] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1589.266128] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1589.266503] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1592.600955] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1592.601378] env[70032]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-45076a2e-9fe6-40cf-9ea3-2047577b6ee5 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1594.267887] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.268250] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1599.269090] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.269427] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1604.270456] env[70032]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.270835] env[70032]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0